-- Logs begin at Fri 2022-09-09 11:32:43 UTC, end at Fri 2022-09-09 12:33:00 UTC. -- Sep 09 12:04:15.333306 dv-cinder-852211-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 12:04:15.341964 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 12:04:15 2022] *** Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: nodename: dv-cinder-852211-12-iscsi Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: machine: x86_64 Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: clock source: unix Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: pcre jit disabled Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: detected number of CPU cores: 4 Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: current working directory: / Sep 09 12:04:15.343898 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: detected binary path: /usr/bin/uwsgi-core Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: your processes number limit is 47680 Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: your memory page size is 4096 bytes Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: detected max file descriptor number: 2048 Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: lock engine: pthread robust mutexes Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: thunder lock: enabled Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 12:04:15.344598 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 12:04:15.382840 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: Python main interpreter initialized at 0x55a70b6429c0 Sep 09 12:04:15.382840 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: python threads support enabled Sep 09 12:04:15.382840 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: your server socket listen backlog is limited to 100 connections Sep 09 12:04:15.382840 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: your mercy for graceful operations on workers is 90 seconds Sep 09 12:04:15.383200 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 12:04:15.383281 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: *** Operational MODE: preforking *** Sep 09 12:04:15.383506 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: *** uWSGI is running in multiple interpreter mode *** Sep 09 12:04:15.383506 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: spawned uWSGI master process (pid: 105601) Sep 09 12:04:15.383691 dv-cinder-852211-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 12:04:15.384724 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: spawned uWSGI worker 1 (pid: 105602, cores: 1) Sep 09 12:04:15.384724 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: spawned uWSGI worker 2 (pid: 105603, cores: 1) Sep 09 12:04:15.384724 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 12:04:16.039360 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:04:16.039984 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:04:17.120184 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:04:17.120184 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: from cryptography.utils import int_from_bytes Sep 09 12:04:17.120792 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:04:17.120792 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: from cryptography.utils import int_from_bytes Sep 09 12:04:17.121813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:04:17.121813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: from cryptography.utils import int_from_bytes Sep 09 12:04:17.122250 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:04:17.122250 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: from cryptography.utils import int_from_bytes Sep 09 12:04:19.655388 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:04:19.655898 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:04:19.656162 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:04:19.656517 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:04:19.656776 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:04:19.657157 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.657478 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.657793 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.658105 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.658430 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.658736 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.659081 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.659396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.659721 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.660005 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.660574 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.660903 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-12-iscsi {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.661222 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.661527 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.661836 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.662154 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.662456 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.662771 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.663104 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.663594 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.664064 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.664371 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.664680 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.665016 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.665348 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.665690 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.666009 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.666315 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.666634 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.666970 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.667379 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-12-iscsi {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.667693 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.668002 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.668311 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.668720 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.669029 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.669332 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.669649 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.669968 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.670273 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.670593 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.670947 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.671247 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.671562 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.671861 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.672166 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.672471 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.672785 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.673086 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.673387 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.673634 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.673937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.674257 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.674573 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.674890 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.675164 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.675410 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.675764 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.676080 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.676385 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.676688 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.676991 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.677295 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.677651 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.678072 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.678471 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.678801 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.679145 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.679457 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.679779 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.680081 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.680396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.680787 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.681036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.681338 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.681674 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.681990 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.682309 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.682623 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.683221 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.683527 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.683830 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.684137 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.684452 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.684781 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.685082 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.685329 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.685625 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.685924 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.686237 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.686539 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.686840 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.687164 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.687460 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.687760 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.688060 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.688361 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.688660 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.688960 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.689258 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.689556 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.689856 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.690155 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.690455 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.690768 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.691106 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.691981 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.692338 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.692749 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.693053 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.693371 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.693674 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.693976 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.694294 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.694600 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.694927 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.695236 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.695539 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.695840 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.696153 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.696450 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.696703 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:04:19.697101 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.697184 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:04:19.697274 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.697355 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.697472 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:04:19.697624 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.697831 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:04:19.697919 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.698084 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:04:19.698212 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.698467 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.698562 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.698787 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.698874 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699207 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699410 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699505 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699707 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.699807 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.700024 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.700112 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.700396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.700484 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.700703 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701007 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701091 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701309 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701621 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701719 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.701960 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.702108 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.702287 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.702631 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.702741 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.702958 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.703290 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.703383 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-12-iscsi {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.703617 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.703887 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.703976 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.704232 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.704429 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.704549 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.704872 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.704961 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.705183 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.705491 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.705580 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.705799 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.706105 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.706194 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.706419 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.706702 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.706863 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.707816 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.707919 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.708503 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.708735 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.708850 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.709130 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.709315 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.709450 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.709777 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.709874 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.710100 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.710410 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.710545 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.710752 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.711057 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.711162 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.711454 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.711629 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.711779 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.711961 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.712100 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.712295 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.712412 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.712612 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.712709 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.712944 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.713041 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.713260 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.713352 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.713648 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.713746 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-12-iscsi {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.713957 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.714045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.714271 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.714359 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.714577 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.714678 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.714926 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.715034 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.715234 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.715330 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.715544 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.715649 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.715853 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.715942 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.716160 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.716248 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.716466 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.716563 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.716800 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.716888 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.717110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.717200 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.717427 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.717518 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.717741 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.717828 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.718038 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.718124 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.718345 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.718435 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.718651 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.718739 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.718982 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.719072 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.719284 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.719372 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.719582 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.719668 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.719828 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.719913 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.720132 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.720221 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.720447 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.720536 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.720748 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.720852 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.721065 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.721153 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.721312 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.721406 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.721544 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.721678 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.721861 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.722006 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.722178 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.722309 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.722582 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.722711 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.723054 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.723152 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.723367 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.723507 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.723658 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.723818 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.723965 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.724125 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.724275 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.724431 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.724579 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.724736 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.724907 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.725041 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.725216 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.725364 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.725519 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.725676 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.725838 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.725993 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.726139 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.726296 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.726442 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.726611 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.726756 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.727024 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.727118 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.727276 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.727390 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.727579 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.727699 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.727915 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.728015 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.728230 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.728327 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.728533 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.728621 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.728848 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.728944 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.729165 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.729261 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.729468 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.729582 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.729770 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.729868 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.730070 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.730159 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.730385 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.730473 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.730715 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.730815 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.731037 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.731127 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.731285 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.731381 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.731584 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.731672 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.731886 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.731976 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.732198 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.732287 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.732500 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.732596 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.732800 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.732896 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.733099 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.733194 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.733392 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.733488 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.733690 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.733788 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.733989 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.734084 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.734289 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.734388 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.734588 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.734676 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.734889 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.735007 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.735212 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.735318 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.735512 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.735601 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.735813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.735901 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.736115 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.736205 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.736416 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.736512 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.736730 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.736818 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.737046 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.737136 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.737428 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.737515 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.737740 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.738106 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.738213 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.738421 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.738659 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.738755 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.739049 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.739276 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.739381 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.739661 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.739883 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.739972 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.740271 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.740459 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.740578 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.740896 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.740989 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.741202 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.741518 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.741609 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.741819 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.742124 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.742277 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.742459 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.742704 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.742802 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.743110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.743334 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.743424 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.743726 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.743929 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.744029 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.744331 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.744527 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.744644 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.744882 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.744978 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.745197 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.745286 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.745517 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.745613 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.745832 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.746001 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.746144 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.746273 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.746448 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.746536 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.746758 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.746845 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.747087 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.747178 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.747395 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.747483 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.747693 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.747798 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.747995 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.748082 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.748301 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.748396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.748602 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.748700 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.748922 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.749011 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.749229 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.749325 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.749542 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.749638 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.749845 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.749933 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.750148 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.750242 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.750452 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.750552 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:04:19.750753 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.750850 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751076 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751170 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751382 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751471 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751692 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751818 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.751999 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752089 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752304 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752401 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752602 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752691 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.752923 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.753019 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.753214 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.753306 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.753514 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.754156 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.754356 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.754625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.754750 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.754989 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755084 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755301 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755399 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755617 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755715 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.755933 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756022 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756233 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756330 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756531 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756621 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756847 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.756951 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757153 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757250 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757454 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757545 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757752 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.757842 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758048 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758136 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758385 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758482 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758689 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.758786 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759015 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759123 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759329 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759418 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759645 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759746 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.759951 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760049 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760260 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760349 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760565 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760661 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760868 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.760973 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761184 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761273 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761495 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761584 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761798 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.761936 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762104 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762199 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762406 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762495 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762709 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.762799 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763038 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763128 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763349 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763438 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763652 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763741 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.763957 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764044 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764259 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764360 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764556 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764646 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764857 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.764946 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.765174 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.765262 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.765494 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.765740 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.765829 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766069 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766157 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766380 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766469 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766697 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.766785 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767026 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767129 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767336 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767434 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767639 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767729 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.767940 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768028 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768240 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768336 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768546 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768634 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768846 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.768942 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.769156 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.769271 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770015 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770200 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770323 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770628 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770716 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.770955 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771088 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771259 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771405 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771566 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771722 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.771866 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772043 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772167 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772357 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772449 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772664 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772754 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.772977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773066 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773293 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773404 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773602 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773699 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.773925 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774018 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774237 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774324 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774545 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774634 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774864 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.774998 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775191 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775279 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775496 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775587 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.775907 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776125 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776233 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776433 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776533 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776746 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.776842 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777057 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777155 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777378 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777474 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777678 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777772 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.777983 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778079 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778289 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778378 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778590 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778687 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778890 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.778998 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779306 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779523 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779613 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779821 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.779911 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780127 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780215 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780431 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780520 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780735 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.780823 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781039 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781128 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781337 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781434 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781642 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781730 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.781938 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782033 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782238 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782338 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782539 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782627 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782838 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.782965 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783152 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783254 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783460 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783549 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783764 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.783852 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784060 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784235 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784359 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784455 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784655 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.784758 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785005 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785109 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785308 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785552 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785650 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785895 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.785992 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786203 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786300 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786509 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786598 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786808 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.786926 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787152 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787246 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787461 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787550 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787760 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.787857 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788058 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788147 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788363 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788452 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788661 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788759 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.788957 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789046 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789262 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789350 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789577 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789673 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789886 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.789981 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790184 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790273 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790489 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790578 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790789 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.790879 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791115 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791205 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791430 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791520 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791766 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.791854 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792062 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792151 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792364 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792483 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792662 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792764 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.792962 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793060 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793260 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793359 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793580 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793680 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.793882 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794001 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794183 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794280 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794486 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794594 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794787 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.794886 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795116 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795216 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795430 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795519 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795741 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.795844 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.796060 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.796150 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.796367 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.796457 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.796949 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797059 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797059 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797227 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797310 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797388 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797572 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797660 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797873 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.797963 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798186 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798275 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798491 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798582 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798800 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.798889 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799124 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799214 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799425 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799515 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799731 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.799822 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800033 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800122 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800334 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800430 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800766 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.800857 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801134 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801311 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801458 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801687 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801785 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.801998 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802087 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802304 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802447 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802618 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802707 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.802951 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803044 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803252 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803343 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803557 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803690 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803864 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.803952 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804171 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804271 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804476 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804568 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804787 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.804876 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805087 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805178 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805389 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805476 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805688 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805789 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.805983 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806071 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806301 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806602 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806704 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.806912 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807002 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807221 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807307 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807518 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807616 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807825 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.807913 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.808379 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.808467 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.808700 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.808798 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809017 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809106 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809326 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809423 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809640 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809737 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.809947 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810043 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810253 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810341 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810562 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810660 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.810869 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811016 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811189 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811278 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811495 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811592 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811803 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.811901 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812108 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812196 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812412 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812556 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812729 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.812819 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813033 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813202 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813339 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813428 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813639 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813764 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.813936 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814042 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814237 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814355 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814544 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814672 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.814862 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815119 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815211 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815446 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815543 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815761 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.815883 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.816077 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.816725 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817106 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817205 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817518 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817645 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817828 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.817978 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818137 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818306 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818457 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818617 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818778 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.818939 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819124 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819252 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819429 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819555 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819740 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.819857 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820048 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820164 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820367 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820456 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820686 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820775 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.820994 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821082 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821305 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821393 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821608 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821730 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.821907 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822006 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822202 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822302 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822519 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822607 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822814 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.822926 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823139 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823241 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823446 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823744 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.823855 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824171 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824368 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824486 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824670 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824791 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.824969 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825098 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825268 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825405 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825607 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825702 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825909 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.825997 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826343 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826574 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826671 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826879 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.826998 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827205 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827295 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827511 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827601 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827811 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.827900 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828111 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828199 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828410 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828496 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828709 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.828801 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829015 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829102 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829320 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829417 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829621 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829710 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.829927 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830015 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830226 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830322 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830529 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830615 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830833 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.830939 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.831157 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.831263 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.831458 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.831553 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.831774 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.832467 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.832670 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.832918 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833016 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833280 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833368 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833587 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833684 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833891 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.833982 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834204 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834300 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834511 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834608 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.834976 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835148 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835259 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835450 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835552 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835762 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.835874 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836063 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836198 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836370 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836502 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836671 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836802 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.836980 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837288 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837414 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837588 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837719 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.837907 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838021 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838216 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838330 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838517 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838618 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838816 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.838931 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839147 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839237 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839446 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839538 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839745 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.839841 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840052 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840141 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840373 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840461 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840685 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840855 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.840985 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841074 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841291 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841378 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841591 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841686 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841890 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.841978 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842190 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842277 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842495 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842591 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842797 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.842914 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843118 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843206 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843419 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843522 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843719 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.843816 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844019 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844113 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844336 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844432 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844641 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844737 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.844942 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845073 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845242 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845339 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845540 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845629 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845853 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.845947 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.846165 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.846251 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.846521 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.846677 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.846823 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.847025 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.847160 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.847338 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.847746 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.847836 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848067 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848266 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848429 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848586 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848745 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.848902 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849049 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849216 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849364 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849529 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849674 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849839 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.849987 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850149 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850289 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850477 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850591 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850797 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.850937 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851145 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851234 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851482 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851574 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851796 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.851885 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852208 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852425 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852514 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852736 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.852838 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853070 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853176 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853335 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853432 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853641 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853730 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.853946 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854043 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854253 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854350 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854559 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854647 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854867 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.854979 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855204 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855311 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855516 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855604 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855828 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.855925 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856135 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856295 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856445 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856535 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856750 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.856839 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857052 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857139 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857370 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857458 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857677 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857775 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.857975 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858064 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858279 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858381 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858578 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858674 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.858882 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859023 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859202 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859416 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859621 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859717 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.859928 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860048 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860232 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860372 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860532 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860692 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.860835 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861006 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861140 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861319 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861451 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861642 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861761 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.861944 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862062 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862244 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862470 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862559 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862778 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.862872 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.863146 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.863268 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.863492 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.863704 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.863804 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864014 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864132 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864313 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864412 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864619 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864717 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.864938 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865199 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865298 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865526 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865631 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865826 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.865938 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866143 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866242 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866448 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866547 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866761 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.866871 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867107 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867206 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867429 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867519 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867733 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.867838 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868035 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868170 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868348 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868479 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868655 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868786 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.868953 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869105 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869252 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869424 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869560 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869748 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.869849 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870049 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870146 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870357 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870454 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870663 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.870761 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871011 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871122 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871329 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871430 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871629 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871718 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.871927 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872016 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872227 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872315 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872524 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872611 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872823 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.872911 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873124 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873228 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873423 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873524 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873726 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.873848 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874025 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874166 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874333 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874473 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874636 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874789 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.874966 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875140 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875309 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875443 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875615 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875743 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.875916 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876049 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876236 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876350 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876541 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876640 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876841 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.876959 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877159 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877248 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877465 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877563 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877784 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.877875 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.878092 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.878183 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.878402 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.878505 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.879358 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.879682 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880094 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880204 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880451 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880543 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880773 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.880862 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881110 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881200 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881437 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881538 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881751 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.881840 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882054 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882143 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882355 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882452 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882674 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.882764 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883007 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883114 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883316 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883414 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883622 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883720 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.883923 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884021 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884229 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884317 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884539 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884628 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884843 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.884946 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885151 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885241 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885456 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885545 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885759 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.885870 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886063 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886153 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886367 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886457 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886672 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886770 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.886997 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887092 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887312 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887404 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887649 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887740 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.887965 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888054 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888268 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888357 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888577 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888666 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888881 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.888975 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889184 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889278 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889484 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889572 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889786 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.889881 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890085 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890181 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890390 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890479 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890693 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.890789 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891026 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891136 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891330 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891427 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891649 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.891960 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892047 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892261 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892415 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892564 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892662 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892865 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.892974 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893200 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893288 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893504 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893667 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893829 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.893928 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.894135 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.894230 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.895065 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.895341 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.895448 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.895674 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.895765 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896011 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896100 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896338 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896427 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896661 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896752 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.896967 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897056 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897271 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897369 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897572 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897668 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897878 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.897975 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898196 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898298 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898504 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898607 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898806 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.898913 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899130 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899352 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899444 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899680 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899769 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.899994 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900083 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900301 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900406 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900602 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900702 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.900908 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901007 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901207 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901296 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901506 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901803 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.901901 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902102 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902191 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902400 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902489 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902699 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.902798 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903031 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903127 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903332 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903460 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903632 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903769 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.903932 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904020 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904234 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904324 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904542 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904641 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904871 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.904959 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905203 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905300 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905514 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905604 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905820 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.905915 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906124 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906221 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906435 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906522 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906740 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.906830 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907073 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907177 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907384 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907482 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907692 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907781 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.907999 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908101 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908307 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908396 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908619 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908708 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.908923 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909020 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909230 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909320 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909536 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.909843 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.910059 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.910193 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.910325 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.910516 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.910817 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911032 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911153 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911244 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911473 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911563 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911785 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.911988 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912100 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912306 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912416 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912641 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912738 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.912968 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913058 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913293 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913389 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913611 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913719 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.913913 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914004 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914219 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914310 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914524 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914629 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914824 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.914933 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915156 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915245 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915463 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915553 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915765 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.915858 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916076 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916171 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916383 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916481 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916685 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.916776 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917000 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917097 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917306 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917395 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917641 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.917986 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918178 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918297 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918492 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918636 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918813 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.918984 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919160 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919296 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919474 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919603 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919778 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.919904 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.920100 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.920191 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:04:19.920405 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.920706 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.921018 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.921325 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.921625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.921926 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.922233 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.922539 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.922840 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.923172 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.923475 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.923797 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.924101 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.924399 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.924697 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.925003 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.925302 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.926125 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.926695 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.927044 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.927361 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.927666 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.927974 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.928283 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.928594 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.928952 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.929261 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.929564 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.929883 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.930197 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.930484 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.930796 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.931130 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.931452 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.931762 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.932071 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.932415 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.932729 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.933518 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.933847 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.934168 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.934494 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.934820 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.935160 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.935463 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.935764 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.936086 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.936395 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.936705 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.937015 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.937324 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.937631 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.937938 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.938250 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.938556 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.938862 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.939194 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.939502 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.939808 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.940116 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.940421 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.940736 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.941084 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.942067 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.942585 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.942928 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.943257 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.943570 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.943880 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.944193 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.944500 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.944816 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.945149 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.945462 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.945767 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.946491 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.946816 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.947176 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.947504 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.947821 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.948149 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.948480 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.948806 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.949131 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.949448 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.949784 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.950127 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.950455 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.950781 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.951114 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.951421 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.951726 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.952037 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.952357 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.952666 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.952970 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.953273 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.953581 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.953885 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.954199 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.954491 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.954793 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.955127 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.955433 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.955735 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.956035 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.956337 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.956638 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.956971 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.957489 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.957955 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.958273 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.958582 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.958893 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.959224 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.959569 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.959907 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.960227 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.960551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.960866 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.961188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.961499 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.961822 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.962143 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.962464 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.962774 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.963138 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.963454 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.963768 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.964081 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.964393 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.964704 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.965014 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.965344 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.965668 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.965972 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.966296 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.966613 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.966958 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.967275 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.967584 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.967913 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.968229 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.968540 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.968862 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.969172 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.969480 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.969795 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.970121 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.970413 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.970728 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.971093 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.971425 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.971751 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.972061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.972418 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.972751 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.973387 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.973812 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.974188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.974508 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.974825 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.975166 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.975476 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:04:19.975723 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:04:20.073661 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO dbcounter [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Registered counter for database nova_api Sep 09 12:04:20.094384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_db.sqlalchemy.engines [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.101111 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writer thread running {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.135570 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO dbcounter [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Registered counter for database nova_api Sep 09 12:04:20.155673 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_db.sqlalchemy.engines [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.162196 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writer thread running {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.162663 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.context [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25a97952-6949-40d3-b857-a309e55901ef(cell1) {{(pid=105602) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:04:20.166737 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:20.167228 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:20.168758 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:20.169466 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:20.169904 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:20.171881 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:20.173887 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO dbcounter [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Registered counter for database nova_cell0 Sep 09 12:04:20.178404 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO dbcounter [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Registered counter for database nova_cell1 Sep 09 12:04:20.186318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_db.sqlalchemy.engines [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.187995 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_db.sqlalchemy.engines [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.194426 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writer thread running {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.196185 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writer thread running {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.220840 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.context [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25a97952-6949-40d3-b857-a309e55901ef(cell1) {{(pid=105603) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:04:20.224889 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:20.225368 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:20.226963 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:20.227683 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:20.228139 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:20.230141 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_concurrency.lockutils [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:20.232156 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO dbcounter [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Registered counter for database nova_cell0 Sep 09 12:04:20.236182 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO dbcounter [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Registered counter for database nova_cell1 Sep 09 12:04:20.243985 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_db.sqlalchemy.engines [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.247686 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_db.sqlalchemy.engines [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.249447 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writer thread running {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.343028 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO dbcounter [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Registered counter for database nova_cell0 Sep 09 12:04:20.350808 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_db.sqlalchemy.engines [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.355125 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writer thread running {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.394027 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writer thread running {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.403634 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO dbcounter [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Registered counter for database nova_cell0 Sep 09 12:04:20.412683 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG oslo_db.sqlalchemy.engines [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:04:20.417374 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writer thread running {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:04:20.695860 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: WARNING keystonemiddleware.auth_token [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:04:20.702997 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: WARNING keystonemiddleware.auth_token [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:04:20.736112 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: WARNING keystonemiddleware.auth_token [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:04:20.744221 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: WARNING keystonemiddleware.auth_token [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:04:21.044408 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: WARNING keystonemiddleware.auth_token [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:04:21.050321 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: WARNING keystonemiddleware.auth_token [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:04:21.056535 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a70b6429c0 pid: 105602 (default app) Sep 09 12:04:21.058852 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:21.060055 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002006 Sep 09 12:04:21.060467 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Fri Sep 9 12:04:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:04:21.086980 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: WARNING keystonemiddleware.auth_token [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:04:21.093092 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: WARNING keystonemiddleware.auth_token [None req-8e75ba91-9085-4d3d-8893-39fe64d39094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:04:21.099931 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a70b6429c0 pid: 105603 (default app) Sep 09 12:05:42.940255 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:42.941178 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 09 12:05:42.941583 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:05:42.954190 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_api:SELECT=3 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:42.955509 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_cell0:SELECT=3 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:42.956361 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_cell1:SELECT=3 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:42.957228 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_cell0:SELECT=3 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:43.827268 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-7c287319-34fd-43d3-abcf-5cbd33b442c5 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:43.860441 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-7c287319-34fd-43d3-abcf-5cbd33b442c5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.912107 Sep 09 12:05:43.861227 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 9 12:05:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:05:46.553624 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:46.554879 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-b03b2f77-cc92-4706-8824-6f85048d1059 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 09 12:05:46.555499 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:05:47.029060 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6cb65ae8-4e10-45f0-a75d-7bbf4c12e4e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "swap": 0}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:47.077078 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6cb65ae8-4e10-45f0-a75d-7bbf4c12e4e7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.515021 Sep 09 12:05:47.077807 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:05:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:05:47.093029 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_api:SELECT=3 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:47.093929 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_cell0:SELECT=3 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:47.095953 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_cell1:SELECT=3 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:47.096833 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:47.308148 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-7eea4ea3-8de7-4977-8a74-17f6ddad5fa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:47.379181 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-7eea4ea3-8de7-4977-8a74-17f6ddad5fa8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292715 Sep 09 12:05:47.379772 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 9 12:05:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:05:50.015325 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6cb65ae8-4e10-45f0-a75d-7bbf4c12e4e7 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:50.016349 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6cb65ae8-4e10-45f0-a75d-7bbf4c12e4e7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 09 12:05:50.017008 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:05:50.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-374289f0-0e6d-4aff-a406-e6421b19565c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:50.721491 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-374289f0-0e6d-4aff-a406-e6421b19565c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697721 Sep 09 12:05:50.723023 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:05:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:05:50.735835 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-071349f2-d88e-4c3f-92ae-aa6ef153ff73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:50.790041 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-071349f2-d88e-4c3f-92ae-aa6ef153ff73 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059109 Sep 09 12:05:50.791279 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 9 12:05:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:05:53.429720 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-374289f0-0e6d-4aff-a406-e6421b19565c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:53.430761 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-374289f0-0e6d-4aff-a406-e6421b19565c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 Sep 09 12:05:53.431240 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:05:53.879455 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-b91e0701-9e80-4cc5-b847-7101830139a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:53.899899 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-b91e0701-9e80-4cc5-b847-7101830139a3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461588 Sep 09 12:05:53.900464 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:05:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:05:53.913565 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-ed67e79a-c452-4b96-bb64-72cacc791ac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:53.942937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-ed67e79a-c452-4b96-bb64-72cacc791ac9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033049 Sep 09 12:05:53.944346 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 9 12:05:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:05:56.546507 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-b91e0701-9e80-4cc5-b847-7101830139a3 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:56.547555 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-b91e0701-9e80-4cc5-b847-7101830139a3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 09 12:05:56.547956 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:05:56.991439 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-686514fe-5f79-4a4c-aa79-6fb2558f6803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:57.010355 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-686514fe-5f79-4a4c-aa79-6fb2558f6803 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456418 Sep 09 12:05:57.011195 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:05:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:05:57.023542 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-0c86faf7-05b9-4fdd-a8b9-0be0d8e5fb10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:05:57.055004 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-0c86faf7-05b9-4fdd-a8b9-0be0d8e5fb10 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035389 Sep 09 12:05:57.055735 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 9 12:05:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:05:59.711330 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-686514fe-5f79-4a4c-aa79-6fb2558f6803 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:05:59.712347 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-686514fe-5f79-4a4c-aa79-6fb2558f6803 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Sep 09 12:05:59.712759 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:00.208805 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:00.235446 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515738 Sep 09 12:06:00.236370 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:05:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:00.248640 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-f07bb868-4a3b-4773-940d-52a4686ca508 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:00.272529 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-f07bb868-4a3b-4773-940d-52a4686ca508 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027724 Sep 09 12:06:00.273207 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Fri Sep 9 12:06:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:02.890975 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:02.891970 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 09 12:06:02.892388 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:03.344722 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-ae00e5eb-c674-4d37-a6ca-22116b2380cf admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:03.379583 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-ae00e5eb-c674-4d37-a6ca-22116b2380cf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.480972 Sep 09 12:06:03.380319 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 9 12:06:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:05.991827 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:05.992769 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-67c0a615-86e9-404a-9586-c6790716ec44 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 09 12:06:05.993174 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:06.386488 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-1e35e231-d9f7-4fad-b353-331855e26d86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:06.405985 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-1e35e231-d9f7-4fad-b353-331855e26d86 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.406681 Sep 09 12:06:06.406533 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:06:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:06.419260 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-f302d523-286a-40d5-ad03-6fde9e6f35f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:06.445828 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-f302d523-286a-40d5-ad03-6fde9e6f35f3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030929 Sep 09 12:06:06.446577 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 9 12:06:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:09.040110 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-1e35e231-d9f7-4fad-b353-331855e26d86 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:09.041114 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-1e35e231-d9f7-4fad-b353-331855e26d86 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 09 12:06:09.041518 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:09.463102 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2be95978-988c-4a2a-8e01-fa6df20f2129 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "id": "2", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:09.482816 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-2be95978-988c-4a2a-8e01-fa6df20f2129 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435205 Sep 09 12:06:09.483592 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:06:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:06:09.495634 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-69956829-0e3e-491f-83a8-5a74b9ada386 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:09.519309 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-69956829-0e3e-491f-83a8-5a74b9ada386 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027323 Sep 09 12:06:09.519878 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 9 12:06:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:12.192366 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2be95978-988c-4a2a-8e01-fa6df20f2129 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:12.194125 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-2be95978-988c-4a2a-8e01-fa6df20f2129 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Sep 09 12:06:12.206051 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:12.640846 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-50c3b9f0-29fa-4b4a-8032-dfc596e8bfff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "swap": 0}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:12.665130 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-50c3b9f0-29fa-4b4a-8032-dfc596e8bfff admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.462779 Sep 09 12:06:12.666010 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:06:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:12.678576 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-fe7059a0-6d85-4d0a-8594-6b9ca3125c97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:12.704439 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-fe7059a0-6d85-4d0a-8594-6b9ca3125c97 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029800 Sep 09 12:06:12.705017 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 9 12:06:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:15.369103 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-50c3b9f0-29fa-4b4a-8032-dfc596e8bfff admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:15.371637 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-50c3b9f0-29fa-4b4a-8032-dfc596e8bfff admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003009 Sep 09 12:06:15.372045 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:15.844694 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-d903a9c2-e056-42ac-8c2f-85e360ed6d2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:15.855258 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:15.868817 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-d903a9c2-e056-42ac-8c2f-85e360ed6d2b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.490440 Sep 09 12:06:15.870478 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:06:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:15.882610 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-43f75006-4f30-420e-8564-d31330fb79bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:15.919544 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-43f75006-4f30-420e-8564-d31330fb79bd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040579 Sep 09 12:06:15.920500 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 9 12:06:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:18.589312 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-d903a9c2-e056-42ac-8c2f-85e360ed6d2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:18.590335 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-d903a9c2-e056-42ac-8c2f-85e360ed6d2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Sep 09 12:06:18.590761 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:19.056757 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:19.065438 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:19.082699 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.485872 Sep 09 12:06:19.083496 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Fri Sep 9 12:06:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:19.096794 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-439a0d44-a22e-4ba8-9e0e-28c8611dda90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:19.133019 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-439a0d44-a22e-4ba8-9e0e-28c8611dda90 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039906 Sep 09 12:06:19.134775 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Fri Sep 9 12:06:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:36.436842 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:36.437862 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 09 12:06:36.438276 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:36.448675 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:36.821857 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-a8ecdeed-18b0-439b-b274-2cbbf8eb69c0 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:36.840075 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-a8ecdeed-18b0-439b-b274-2cbbf8eb69c0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395762 Sep 09 12:06:36.840646 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 9 12:06:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:38.141579 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.142578 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-422cc969-38cd-4712-a2a2-336a1612e81c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 09 12:06:38.142997 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:38.669927 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2df9f3f1-5fa0-48cf-95a9-a1036e9687a2 admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.675333 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.wsgi [None req-2df9f3f1-5fa0-48cf-95a9-a1036e9687a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2df9f3f1-5fa0-48cf-95a9-a1036e9687a2 admin admin] Request method failure captured: Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept: application/json Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept-Encoding: gzip, deflate Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Connection: keep-alive Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Content-Length: 0 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Host: 10.222.0.49 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-System-Scope: None Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: User-Agent: python-novaclient Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Auth-Token: gAAAAABjGyxOqfFwcaIsGcD1z8kdvuWyDaSKny1QXwAknGIRZd1RYCs17iIUxqFbOfo4DKSE0I55-uZCwWnquyj3yDfvQKgKnwWG_qurGtCgDCE20FP2bXzzwocsE1pzSYIC45rFRm2p3kRb1WLbHHY_qFPMq3YnIAwflyOBvsee9UKQj-URpiY Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Id: None Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Name: None Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Identity-Status: Confirmed Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Is-Admin-Project: True Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Id: default Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Name: Default Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Name: admin Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Role: admin,reader,member Sep 09 12:06:38.678625 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Roles: admin,reader,member Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant: admin Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Name: admin Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User: admin Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Id: default Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Name: Default Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Name: admin Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: method: > Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: exception: Flavor 42 could not be found. Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: action_args: {'id': '42'} Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:38.680551 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:38.681595 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.683061 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2df9f3f1-5fa0-48cf-95a9-a1036e9687a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:38.684792 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-2df9f3f1-5fa0-48cf-95a9-a1036e9687a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396358 Sep 09 12:06:38.684792 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:06:38.690636 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-efa2eb21-8881-4dc7-aeca-54432cec9bd5 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.713136 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-efa2eb21-8881-4dc7-aeca-54432cec9bd5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026366 Sep 09 12:06:38.713684 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:38.724939 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-0b53dd10-1c33-4754-abf5-0a3d06be530e admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.747072 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-0b53dd10-1c33-4754-abf5-0a3d06be530e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026274 Sep 09 12:06:38.747623 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:38.757126 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-c5403acc-b19c-4910-96b2-63db226aee32 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.763230 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.wsgi [None req-c5403acc-b19c-4910-96b2-63db226aee32 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-c5403acc-b19c-4910-96b2-63db226aee32 admin admin] Request method failure captured: Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept: application/json Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept-Encoding: gzip, deflate Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Connection: keep-alive Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Content-Length: 0 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Host: 10.222.0.49 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-System-Scope: None Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: User-Agent: python-novaclient Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Auth-Token: gAAAAABjGyxOqfFwcaIsGcD1z8kdvuWyDaSKny1QXwAknGIRZd1RYCs17iIUxqFbOfo4DKSE0I55-uZCwWnquyj3yDfvQKgKnwWG_qurGtCgDCE20FP2bXzzwocsE1pzSYIC45rFRm2p3kRb1WLbHHY_qFPMq3YnIAwflyOBvsee9UKQj-URpiY Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Id: None Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Name: None Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Identity-Status: Confirmed Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Is-Admin-Project: True Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Id: default Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Name: Default Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Name: admin Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Role: admin,reader,member Sep 09 12:06:38.766696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Roles: admin,reader,member Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant: admin Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Name: admin Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User: admin Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Id: default Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Name: Default Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Name: admin Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: method: > Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: exception: Flavor 42 could not be found. Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: action_args: {'id': '42'} Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:38.768217 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:38.769078 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:38.770318 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-c5403acc-b19c-4910-96b2-63db226aee32 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:38.771576 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-c5403acc-b19c-4910-96b2-63db226aee32 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014732 Sep 09 12:06:38.771576 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 12:06:39.991383 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-0b53dd10-1c33-4754-abf5-0a3d06be530e admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:39.992434 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-0b53dd10-1c33-4754-abf5-0a3d06be530e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 09 12:06:39.992835 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:40.515522 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-ea9d5ea9-f947-4cf6-8d38-e930a10c4faa admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:40.520537 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.wsgi [None req-ea9d5ea9-f947-4cf6-8d38-e930a10c4faa admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-ea9d5ea9-f947-4cf6-8d38-e930a10c4faa admin admin] Request method failure captured: Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept: application/json Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept-Encoding: gzip, deflate Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Connection: keep-alive Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Content-Length: 0 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Host: 10.222.0.49 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-System-Scope: None Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: User-Agent: python-novaclient Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Auth-Token: gAAAAABjGyxPwMKhw75kgxQmyXXM_R15ry2W1ZEYMFl8uC5ZxSkV8wu62gv9_iVMYuchwd66fYk5ITI2uaKuA4h1ql0LE2Lg5uDBocxC_ZpzW2995n__MaT0vy4FVdbGpY--Das4pfHVFUEXxoyzXVBEgmjqJG1mBAy6GJKlMU9UUjdqM0rkYf0 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Id: None Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Name: None Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Identity-Status: Confirmed Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Is-Admin-Project: True Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Id: default Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Name: Default Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Name: admin Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Role: admin,reader,member Sep 09 12:06:40.522036 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Roles: admin,reader,member Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant: admin Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Name: admin Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User: admin Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Id: default Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Name: Default Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Name: admin Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: method: > Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: exception: Flavor 84 could not be found. Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: action_args: {'id': '84'} Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:40.523564 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:40.524463 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.525936 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-ea9d5ea9-f947-4cf6-8d38-e930a10c4faa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:40.528741 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-ea9d5ea9-f947-4cf6-8d38-e930a10c4faa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390927 Sep 09 12:06:40.528741 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:06:40.534147 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-9b3cac7b-b2b4-496f-8ec3-0339a905dfdb admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:40.550186 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-9b3cac7b-b2b4-496f-8ec3-0339a905dfdb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019707 Sep 09 12:06:40.550654 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:06:40.560381 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-0cb41b60-7a5f-45dd-89c1-bf2dbaff468f admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:40.576243 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-0cb41b60-7a5f-45dd-89c1-bf2dbaff468f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019470 Sep 09 12:06:40.576764 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:06:40.586177 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-02d629a9-d6c5-48e8-8b06-754dc854d9aa admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:40.591638 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.wsgi [None req-02d629a9-d6c5-48e8-8b06-754dc854d9aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-02d629a9-d6c5-48e8-8b06-754dc854d9aa admin admin] Request method failure captured: Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept: application/json Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept-Encoding: gzip, deflate Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Connection: keep-alive Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Content-Length: 0 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Host: 10.222.0.49 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-System-Scope: None Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: User-Agent: python-novaclient Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Auth-Token: gAAAAABjGyxPwMKhw75kgxQmyXXM_R15ry2W1ZEYMFl8uC5ZxSkV8wu62gv9_iVMYuchwd66fYk5ITI2uaKuA4h1ql0LE2Lg5uDBocxC_ZpzW2995n__MaT0vy4FVdbGpY--Das4pfHVFUEXxoyzXVBEgmjqJG1mBAy6GJKlMU9UUjdqM0rkYf0 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Id: None Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Name: None Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Identity-Status: Confirmed Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Is-Admin-Project: True Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Id: default Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Name: Default Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Name: admin Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Role: admin,reader,member Sep 09 12:06:40.593265 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Roles: admin,reader,member Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant: admin Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Name: admin Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User: admin Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Id: default Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Name: Default Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Name: admin Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: method: > Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: exception: Flavor 84 could not be found. Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: action_args: {'id': '84'} Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:40.594837 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:40.595977 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:40.597045 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-02d629a9-d6c5-48e8-8b06-754dc854d9aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:40.598025 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-02d629a9-d6c5-48e8-8b06-754dc854d9aa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012225 Sep 09 12:06:40.598025 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 12:06:41.817850 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-0cb41b60-7a5f-45dd-89c1-bf2dbaff468f admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:41.818855 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-0cb41b60-7a5f-45dd-89c1-bf2dbaff468f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 09 12:06:41.819282 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:42.344194 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2848de8d-abaf-4c60-ab67-e2612ff1aa6b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:42.350209 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.wsgi [None req-2848de8d-abaf-4c60-ab67-e2612ff1aa6b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2848de8d-abaf-4c60-ab67-e2612ff1aa6b admin admin] Request method failure captured: Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept: application/json Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Accept-Encoding: gzip, deflate Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Connection: keep-alive Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Content-Length: 0 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Host: 10.222.0.49 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Openstack-System-Scope: None Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: User-Agent: python-novaclient Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Auth-Token: gAAAAABjGyxRyyiBwKvltLcaTtKSqAolyjm2IarOLDNnCfegMCHsH8VJAzUR83JG-jJ8tguE7rXTblW2lnT0P5y7IeSgtT2ZpcYHfaJwcxiKPo647kLD6ZwHMsT-tNaTvsfCUY8HRPmOBv_vS_6Q_-2jkLN8FaM1lJsrcABB6ZdjK8Vw_WH-mo4 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Id: None Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Domain-Name: None Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Identity-Status: Confirmed Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Is-Admin-Project: True Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Id: default Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Domain-Name: Default Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Project-Name: admin Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Role: admin,reader,member Sep 09 12:06:42.351721 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Roles: admin,reader,member Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant: admin Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-Tenant-Name: admin Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User: admin Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Id: default Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Domain-Name: Default Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: X-User-Name: admin Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: method: > Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: exception: Flavor 451 could not be found. Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: action_args: {'id': '451'} Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:42.353247 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:42.354188 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.355557 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-2848de8d-abaf-4c60-ab67-e2612ff1aa6b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:42.356876 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-2848de8d-abaf-4c60-ab67-e2612ff1aa6b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397055 Sep 09 12:06:42.356876 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:06:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:06:42.363215 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-be011cd5-7051-42e4-a68c-0bd062322bf4 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:42.380383 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-be011cd5-7051-42e4-a68c-0bd062322bf4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020732 Sep 09 12:06:42.380912 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:42.390951 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:42.406338 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019606 Sep 09 12:06:42.406855 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Sep 9 12:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:42.416249 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-eedf4007-2237-41d9-a995-cf54d7b2b09e admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:42.421867 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.wsgi [None req-eedf4007-2237-41d9-a995-cf54d7b2b09e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-eedf4007-2237-41d9-a995-cf54d7b2b09e admin admin] Request method failure captured: Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept: application/json Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Accept-Encoding: gzip, deflate Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Connection: keep-alive Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Content-Length: 0 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Host: 10.222.0.49 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-Api-Version: compute 2.92 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Openstack-System-Scope: None Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: User-Agent: python-novaclient Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Auth-Token: gAAAAABjGyxRyyiBwKvltLcaTtKSqAolyjm2IarOLDNnCfegMCHsH8VJAzUR83JG-jJ8tguE7rXTblW2lnT0P5y7IeSgtT2ZpcYHfaJwcxiKPo647kLD6ZwHMsT-tNaTvsfCUY8HRPmOBv_vS_6Q_-2jkLN8FaM1lJsrcABB6ZdjK8Vw_WH-mo4 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Id: None Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Domain-Name: None Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Identity-Status: Confirmed Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Is-Admin-Project: True Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Id: default Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Domain-Name: Default Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Project-Name: admin Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Role: admin,reader,member Sep 09 12:06:42.423384 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Roles: admin,reader,member Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ae50911c7cf74f75b5b41fa5275c8468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant: admin Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Id: ae50911c7cf74f75b5b41fa5275c8468 Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-Tenant-Name: admin Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User: admin Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Id: default Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Domain-Name: Default Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Id: 136011715ec34418adc0f536f6c7357c Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: X-User-Name: admin Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: method: > Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: exception: Flavor 451 could not be found. Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: action_args: {'id': '451'} Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:42.424937 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:42.425864 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: ERROR nova.api.openstack.wsgi Sep 09 12:06:42.427190 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-eedf4007-2237-41d9-a995-cf54d7b2b09e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:42.428510 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-eedf4007-2237-41d9-a995-cf54d7b2b09e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012368 Sep 09 12:06:42.428510 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:06:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:06:43.640725 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:43.641770 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 09 12:06:43.642174 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:44.160829 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-6f6a8ffa-dcbe-4416-bf36-448518280636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:44.181395 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-6f6a8ffa-dcbe-4416-bf36-448518280636 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402888 Sep 09 12:06:44.181878 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 9 12:06:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:45.418846 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:45.420034 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Sep 09 12:06:45.420436 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:45.941032 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-f3f5a3f0-7a01-4cf6-95b4-943ef6ca308d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:45.959207 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-f3f5a3f0-7a01-4cf6-95b4-943ef6ca308d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400063 Sep 09 12:06:45.959745 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 9 12:06:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:47.178792 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.179847 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 09 12:06:47.180515 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:47.701030 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-320046e6-e042-486e-b6d5-e246fb900694 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:47.719796 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-320046e6-e042-486e-b6d5-e246fb900694 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400856 Sep 09 12:06:47.720348 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 9 12:06:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:06:48.943235 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.944256 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Sep 09 12:06:48.944655 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:49.471695 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-0065b5f8-9ed6-4c76-b5d2-728c66701322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:49.489452 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-0065b5f8-9ed6-4c76-b5d2-728c66701322 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406921 Sep 09 12:06:49.490002 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Sep 9 12:06:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:06:50.722054 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:50.723110 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 09 12:06:50.723512 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:51.243912 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-48c7a915-1eaf-4e2a-81a4-80529659371c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.265443 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-48c7a915-1eaf-4e2a-81a4-80529659371c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404363 Sep 09 12:06:51.265919 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:48.460553 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.462231 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6eba8085-1c77-4db5-a18d-75e71f93587c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Sep 09 12:07:48.462635 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:48.473807 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:48.852162 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-0fd0047f-561e-4a88-9edd-736d3e30cb8c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.872997 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-0fd0047f-561e-4a88-9edd-736d3e30cb8c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403595 Sep 09 12:07:48.873537 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:48.895329 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_api:SELECT=14 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:48.899262 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-27d9594a-183d-41a2-a811-4f1e9e79fedd admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.907407 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-27d9594a-183d-41a2-a811-4f1e9e79fedd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013631 Sep 09 12:07:48.907928 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:48.919492 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-a059e128-a4a8-46ef-9347-1e73af17b562 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.927728 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-a059e128-a4a8-46ef-9347-1e73af17b562 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011793 Sep 09 12:07:48.928249 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:48.939789 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.946773 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010504 Sep 09 12:07:48.947333 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:48.958371 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-a821e9a4-6752-48f6-9823-3301f7a1106a admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.965378 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-a821e9a4-6752-48f6-9823-3301f7a1106a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010473 Sep 09 12:07:48.965891 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:44.265013 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:44.266030 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 09 12:10:44.266432 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:44.408067 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_api:SELECT=6 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:44.570165 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:44.575550 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.576031 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.576458 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.577174 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.577623 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.578052 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.610294 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-22d49564-ad69-455c-8ab3-b1a5c24db50c admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.203456 Sep 09 12:10:44.610844 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:10:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:10:45.707220 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:45.708227 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 12:10:45.708622 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:45.903789 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:45.907195 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.907672 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.908099 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.908812 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.909307 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.909657 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.928912 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-979baba8-1872-443a-b5d9-bf9b76500b75 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076703 Sep 09 12:10:45.929431 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:10:45 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:10:57.395966 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:57.396980 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 09 12:10:57.397379 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:57.541696 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_cell0:SELECT=4 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:57.542431 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_cell1:SELECT=4 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:57.543173 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG dbcounter [-] [105602] Writing DB stats nova_api:SELECT=8 {{(pid=105602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:57.592383 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:57.595752 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.596222 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.596648 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.597349 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.597787 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.598199 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.623322 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-e306457c-14a5-44bb-9f5a-a74bd375466a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.086018 Sep 09 12:10:57.623798 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:10:57 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:58.703917 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG nova.api.openstack.wsgi [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] Calling method '>' {{(pid=105603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:58.704956 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: INFO nova.api.openstack.requestlog [None req-6585cbca-2197-419b-8772-5f707e9f3e2b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 09 12:10:58.705354 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: [pid: 105603|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Sep 9 12:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:58.897333 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG nova.api.openstack.wsgi [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Calling method '>' {{(pid=105602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:58.900708 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.901222 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.901651 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.902388 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.902837 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.903275 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: DEBUG oslo_concurrency.lockutils [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.925093 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: INFO nova.api.openstack.requestlog [None req-2262019a-601e-48e8-bcf6-92abe279d579 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.079032 Sep 09 12:10:58.925640 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: [pid: 105602|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Sep 9 12:10:58 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:56.429963 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: Fri Sep 9 12:11:56 2022 - graceful shutdown triggered... Sep 09 12:11:56.430434 dv-cinder-852211-12-iscsi devstack@n-api.service[105602]: Gracefully killing worker 1 (pid: 105602)... Sep 09 12:11:56.430810 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: Gracefully killing worker 2 (pid: 105603)... Sep 09 12:11:56.430583 dv-cinder-852211-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 12:11:56.556612 dv-cinder-852211-12-iscsi devstack@n-api.service[105603]: DEBUG dbcounter [-] [105603] Writing DB stats nova_api:SELECT=4 {{(pid=105603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:57.431062 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: worker 1 buried after 1 seconds Sep 09 12:11:57.431625 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: worker 2 buried after 1 seconds Sep 09 12:11:57.431625 dv-cinder-852211-12-iscsi devstack@n-api.service[105601]: goodbye to uWSGI. Sep 09 12:11:57.432639 dv-cinder-852211-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 12:11:57.433183 dv-cinder-852211-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 12:11:57.436949 dv-cinder-852211-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 12:11:57.445765 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 12:11:57 2022] *** Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: nodename: dv-cinder-852211-12-iscsi Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: machine: x86_64 Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: clock source: unix Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: pcre jit disabled Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: detected number of CPU cores: 4 Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: current working directory: / Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: detected binary path: /usr/bin/uwsgi-core Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: your processes number limit is 47680 Sep 09 12:11:57.448479 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: your memory page size is 4096 bytes Sep 09 12:11:57.449315 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: detected max file descriptor number: 2048 Sep 09 12:11:57.449315 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: lock engine: pthread robust mutexes Sep 09 12:11:57.449315 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: thunder lock: enabled Sep 09 12:11:57.449315 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 12:11:57.449315 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 12:11:57.488187 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: Python main interpreter initialized at 0x558d00ef29c0 Sep 09 12:11:57.488187 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: python threads support enabled Sep 09 12:11:57.488187 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: your server socket listen backlog is limited to 100 connections Sep 09 12:11:57.488187 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: your mercy for graceful operations on workers is 90 seconds Sep 09 12:11:57.488576 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 12:11:57.488651 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: *** Operational MODE: preforking *** Sep 09 12:11:57.488889 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: *** uWSGI is running in multiple interpreter mode *** Sep 09 12:11:57.488889 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: spawned uWSGI master process (pid: 120578) Sep 09 12:11:57.489078 dv-cinder-852211-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 12:11:57.490151 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: spawned uWSGI worker 1 (pid: 120591, cores: 1) Sep 09 12:11:57.490151 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: spawned uWSGI worker 2 (pid: 120593, cores: 1) Sep 09 12:11:57.490151 dv-cinder-852211-12-iscsi devstack@n-api.service[120578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 12:11:58.174337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:11:58.175074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:11:59.344161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:11:59.344161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: from cryptography.utils import int_from_bytes Sep 09 12:11:59.344822 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:11:59.344822 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: from cryptography.utils import int_from_bytes Sep 09 12:11:59.354709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:11:59.354709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: from cryptography.utils import int_from_bytes Sep 09 12:11:59.355207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:11:59.355207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: from cryptography.utils import int_from_bytes Sep 09 12:12:01.789150 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:12:01.789787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:12:01.789966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:12:01.790335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:12:01.790596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:12:01.791016 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.791348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.791673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.791999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.792336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.792653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.792982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.793848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.794632 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.795276 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.795611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.796211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-12-iscsi {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.796553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.796877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.797201 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.797535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.797849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.798184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.798499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.799098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.800419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.800419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.800419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.800698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.800888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.802315 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.802663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.803023 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.803591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.804139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.804577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-12-iscsi {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.804919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.805246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.805574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.806018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.806341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.806664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.807025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.807364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.807683 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.808023 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.808353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.808683 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.809661 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.809976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.810446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.810782 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.811142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.811721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.812038 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.812299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.812616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.812950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.813283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.813616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.813876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.814133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.814460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.814789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.815135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.815453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.815766 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.816078 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.816391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.816704 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.817014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.817325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.817652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.817974 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.818304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.818618 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.818966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.819383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.819644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.819959 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.820308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.820635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.820948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.821274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.821601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.821917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.822233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.822548 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.822873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.823258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.823742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.824158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.824747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.825520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.826082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.826558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.827080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.827580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.827894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.828213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.828683 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.829006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.829323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.829642 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.829965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.830281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.830596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.830949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.831905 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.831905 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.831905 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.832493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.832493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.832778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.833089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.833477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.833792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.834105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.834433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.834745 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.835098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.835428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.835742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.836053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.836379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.836687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.836999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.837329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.837644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.837756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:12:01.838148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:12:01.838234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.838234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.838483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:12:01.838580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.838824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:12:01.839133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.839230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:12:01.839306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.839481 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.839584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.839770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.839870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840079 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840452 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.840982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841517 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.841955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.842179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.842291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.842438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.842532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.842772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.842975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.843221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.843382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-12-iscsi {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.843527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.843680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.843850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.844002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.844209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.844366 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.844536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.844692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.844858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.845006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.845188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.845337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.845514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.845668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.845863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.846020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.846221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.846369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.846511 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.846654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.846806 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.847031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.847183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.847333 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.847477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.847632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.847775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.847931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.848076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.848226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.848368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.848510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.848667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.848825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.848975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.849118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.849261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.849416 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-12-iscsi {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.849580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.849732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.849875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.850025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.850175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.850332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.850499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.850660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.850813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.851001 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.851165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.851319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.851473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.851617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.851760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.851963 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.852124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.852328 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.852486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.852647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.852792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.852978 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.853154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.853309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.853453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.853648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.853805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.853958 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.854111 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.854280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.854440 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.854601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.854753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.854917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.855085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.855237 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.855393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.855542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.855705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.856468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.856777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.856976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.857147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.857147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.857424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.857582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.857734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.857885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.858032 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.858184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.858345 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.858500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.858646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.858800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.858972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.859135 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.859290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.859441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.859594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.859737 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.859879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.860021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.860203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.860350 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.860499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.860650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.860800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.860967 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.861121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.861273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.861423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.861591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.861768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.861926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.862084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.862084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.862391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.862544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.862689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.862841 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.863023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.863178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.863358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.863516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.863670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.863834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.863980 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.864123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.864277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.864420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.864581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.864735 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.864897 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.865053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.865205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.865352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.865496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.865651 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.865804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.865949 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.866129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.866295 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.866449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.866601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.866744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.866887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.867107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.867252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.867480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.867634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.867776 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.867927 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.868085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.868251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.868403 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.868562 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.868706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.868855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.869014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.869167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.869310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.869467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.869619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.869813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.870137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.870309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.870500 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.870663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.870815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.871005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.871158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.871302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.871536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.872227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.872488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.872701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.872860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.873028 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.873190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.873347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.873490 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.873640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.873784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.873926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.874082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.874236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.874386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.874538 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.874681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.874824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.875050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.875211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.875364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.875511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.875654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.875805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.875963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.876115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.876260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.876417 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.876561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.876712 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.876855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.876998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.877161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.877321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.877472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.877625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.877776 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.877928 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.878082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.878227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.878369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.878512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.878663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.878815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.878988 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.879156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.879309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.879462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.879614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.879758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.879910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.880054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.880226 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.880375 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.880527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.880677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.880837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.880980 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.881133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.881276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.881418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.881576 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.881721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.881862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.882012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.882155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.882298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.882452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.882604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.882748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.882926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.883087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.883242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.883400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.883545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.883696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.883841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.883991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.884143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.884299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.884443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.884585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.884735 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.884893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.885045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:12:01.885202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.885365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.885520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.885664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.885816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886169 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.886816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.887895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888198 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.888942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889551 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.889878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890333 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890676 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.890838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891341 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.891937 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.892976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893129 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893282 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893434 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.893863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894015 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894696 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.894850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.895942 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896086 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896411 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896558 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896710 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.896868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897326 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897626 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897783 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.897928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.898915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.899860 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900789 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.900943 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901105 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901249 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901406 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.901861 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902628 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.902998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.903161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.903431 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.903592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.903771 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.903922 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904760 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.904920 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.905991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.906271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.906433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.906591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.906870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.907843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.908846 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909624 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.909933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910077 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910378 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.910821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.911936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912529 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912673 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.912966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.913878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914029 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914634 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.914978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.915940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916413 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916713 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.916861 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.917981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.918136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.918878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919427 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.919886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.920961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921570 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.921884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.922817 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923112 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.923957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924605 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.924930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925722 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.925888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.926857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927036 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.927961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928111 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.928916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929522 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929833 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.929983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930282 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.930985 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.931913 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932077 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932400 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.932888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933040 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.933824 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.934669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.934835 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.935947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.936092 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.936236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.936636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.936792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.936957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.937893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938207 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.938854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939548 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.939865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.940947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941569 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.941887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942045 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.942993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943159 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943324 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943484 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.943955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.944947 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945098 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945417 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945733 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.945889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.946846 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947070 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947713 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.947864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948341 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948492 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948801 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.948998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.949158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.949310 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.949479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.949671 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.949850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950311 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.950959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.951262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.951262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.951559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.951735 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.951735 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952341 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952506 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952808 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.952958 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953109 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953749 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.953901 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954531 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.954832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955720 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.955891 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956058 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956381 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.956861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957013 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957493 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.957816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958264 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.958887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959229 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.959871 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960658 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960808 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.960957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961431 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961582 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961731 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.961893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962276 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.962942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963279 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.963899 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964070 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964383 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964691 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.964991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.965420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.965577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.965735 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.965894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.966681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967373 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967531 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.967851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.968974 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969137 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969770 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.969930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.970863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971539 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.971866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972024 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.972978 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.973898 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974047 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974380 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974532 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.974841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975640 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.975947 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.976898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977678 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977828 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.977993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978462 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.978941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979101 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.979913 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.980066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.980223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.980386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.980537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.980695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.981390 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.981542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.981699 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.981859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982180 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.982795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.983948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984567 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.984972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.985907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.986855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987343 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.987878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988672 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.988991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989621 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.989939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990098 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990248 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990724 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.990882 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991552 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.991852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992471 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.992947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993280 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993431 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993741 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.993902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.994842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.995981 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.996133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.996284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.996519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.997194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.997356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.997591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.997753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.997905 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.998849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:01.999868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000339 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.000958 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.001887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002198 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.002992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.003790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.004868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005500 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.005970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006454 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.006933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007109 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.007904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008672 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.008979 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.009144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.009296 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.009446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.009446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.009752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.010516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.010692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.010846 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.010846 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.011970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.012177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.012342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.012534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.012807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.012962 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.013903 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.014853 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015029 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.015886 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016506 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016835 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.016994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.017936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018088 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.018874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019691 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.019850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.020969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021580 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021729 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.021890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022699 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.022852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023200 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.023966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024427 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.024911 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025694 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.025847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.026980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.027144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.027309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.027470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.027664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.027827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.028934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029083 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029399 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.029859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030494 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.030814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.031996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.032944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033404 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.033870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.034812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.035933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036086 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.036870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037332 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037493 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037797 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.037947 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038410 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.038882 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039729 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.039891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040051 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040830 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.040995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041760 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.041921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.042866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.043045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.043197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.044511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.044689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.044855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045008 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045634 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.045882 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046036 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046347 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.046827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047159 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047625 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047625 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.047945 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048719 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.048719 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049164 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.049954 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050425 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.050877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.051880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.052969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053135 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053455 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.053934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.054097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.054255 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.054407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.054558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.054709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.055517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.055685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.055837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.055989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056471 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.056947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.057762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.058064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.058217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.058377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.058548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.058700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.059054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.059735 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.059907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060625 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.060952 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.061104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.061274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.061689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.061689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.061979 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062770 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.062960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.063120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.063279 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.063438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.064189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.064365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.064535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.064690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.064840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065153 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.065934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.066243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.066243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.066552 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.066715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.066876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.067275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.068427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.069548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.070707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.070707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.070707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.070707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.071302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.071302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.071615 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.071784 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.072077 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.072394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.072712 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.073029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.073345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.073667 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.074016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.074343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.074751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.075134 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.075426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.075745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.076065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.076383 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.076700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.077023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.077362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.077683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.077997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.078436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.078757 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.079107 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.079438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.079755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.080084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.080414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.080732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.081059 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.081374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.081711 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.082057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.082393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.082724 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.083062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.084035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.086931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.087579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.087655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.087926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.088486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.088814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.089139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.089462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.089782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.090102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.090450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.090778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.091186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.091510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.091831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.092151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.092468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.092819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.093173 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.093496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.093838 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.094163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.094499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.094829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.095193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.095533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.095865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.096325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.096683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.097006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.097484 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.097823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.098149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.098672 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.099032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.099380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.099721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.100041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.100489 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.100828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.101162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.101492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.101816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.102158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.102482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.102805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.103149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.103476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.103798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.104126 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.104446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.104774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.105103 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.105429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.106300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.106643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.107025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.107335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.107788 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.108157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.108664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.108991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.109322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.109648 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.109974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.110290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:12:02.110544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:12:02.127274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Registered counter for database nova_api Sep 09 12:12:02.150517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.158788 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.176381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Registered counter for database nova_api Sep 09 12:12:02.197398 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.205192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.218513 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.context [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25a97952-6949-40d3-b857-a309e55901ef(cell1) {{(pid=120591) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:12:02.222602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:02.223186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:02.224768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:02.225566 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:02.226016 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:02.228033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:02.230017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Registered counter for database nova_cell0 Sep 09 12:12:02.234656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Registered counter for database nova_cell1 Sep 09 12:12:02.241895 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.244740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.249135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.264171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.context [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25a97952-6949-40d3-b857-a309e55901ef(cell1) {{(pid=120593) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:12:02.268227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:02.268708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:02.270276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:02.271051 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:02.271503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:02.273494 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:02.275513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Registered counter for database nova_cell0 Sep 09 12:12:02.280175 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Registered counter for database nova_cell1 Sep 09 12:12:02.287653 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.289413 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.295546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.298137 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.390070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.400101 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Registered counter for database nova_cell0 Sep 09 12:12:02.407492 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.411814 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.446154 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Registered counter for database nova_cell0 Sep 09 12:12:02.454839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:12:02.459395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:12:02.734467 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:12:02.742018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:12:02.787761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:12:02.795451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:12:03.088976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:12:03.095858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-e43a0bfa-684c-431d-b316-b5df44339441 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:12:03.101172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d00ef29c0 pid: 120591 (default app) Sep 09 12:12:03.145872 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:12:03.151906 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-3e7277a6-59a8-4b12-b06b-b3fb0aa02b8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:12:03.157826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d00ef29c0 pid: 120593 (default app) Sep 09 12:12:40.107265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.110333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.111891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.114649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.262388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.263586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.264850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:40.267454 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:41.729864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-79025381-29a6-49a5-9193-e1f8574b8139 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Action: 'create', calling method: .version_select at 0x7f6bd1c553a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1988862548"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:41.749924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bfc4d074-96a8-4c1f-866c-729babc8490b tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Action: 'create', calling method: .version_select at 0x7f6bd1c503a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1327308804", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:43.098944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-79025381-29a6-49a5-9193-e1f8574b8139 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.015123 Sep 09 12:12:43.100541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Fri Sep 9 12:12:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3018 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 12:12:43.117306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ebdbfb19-2714-4d1f-8ecc-44502e662599 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b37280>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:43.617840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ebdbfb19-2714-4d1f-8ecc-44502e662599 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 200 len: 346 microversion: 2.1 time: 0.505137 Sep 09 12:12:43.618412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:43 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 346 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:43.638396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a17a1b48-3795-4252-98ea-588170f9c70b tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Action: 'create', calling method: .version_select at 0x7f6bd1b37940>, body: {"snapshot": {"volume_id": "58955b58-2d60-4469-823c-76f97f8a2fbb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1767446041"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:43.731997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bfc4d074-96a8-4c1f-866c-729babc8490b tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.474136 Sep 09 12:12:43.733772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 9 12:12:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3479 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 09 12:12:43.749183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-904c027b-4c6a-4d95-bc14-0052ffbe5de1 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1b36280>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.110242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-904c027b-4c6a-4d95-bc14-0052ffbe5de1 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 200 len: 353 microversion: 2.1 time: 0.365619 Sep 09 12:12:44.110817 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:43 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 353 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:44.116165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8ca8d2bf-cbe0-4bd2-9542-95d36e7c6ecc tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1b36940>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.196343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8ca8d2bf-cbe0-4bd2-9542-95d36e7c6ecc tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/44992a12-bb2a-48d8-90e2-78d66da5bd05" status: 200 len: 350 microversion: 2.1 time: 0.084419 Sep 09 12:12:44.196907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/os-volumes/44992a12-bb2a-48d8-90e2-78d66da5bd05 => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:44.314739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a17a1b48-3795-4252-98ea-588170f9c70b tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.683638 Sep 09 12:12:44.321040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 3/6] 10.222.0.49 () {60 vars in 1162 bytes} [Fri Sep 9 12:12:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:44.327175 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-60fbf078-3332-4ba7-8042-94c9ee89ac58 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abd0d0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.409595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-60fbf078-3332-4ba7-8042-94c9ee89ac58 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 287 microversion: 2.1 time: 0.086851 Sep 09 12:12:44.410317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:44.427266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-94b87657-396d-44ee-9dc7-d2d42c9e690b tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abdc10>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.544262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-94b87657-396d-44ee-9dc7-d2d42c9e690b tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.076519 Sep 09 12:12:44.544262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:44.545876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e3c6bc86-4689-4898-a31a-37a310d34f88 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b36c10>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.572260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e3c6bc86-4689-4898-a31a-37a310d34f88 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 287 microversion: 2.1 time: 0.067795 Sep 09 12:12:44.572884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:45.135071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b1fc8880-00c4-45b6-b258-1a9737142b29 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1b37430>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.262972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b1fc8880-00c4-45b6-b258-1a9737142b29 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 200 len: 354 microversion: 2.1 time: 0.141412 Sep 09 12:12:45.264205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:45.278127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50e73e4b-936f-4bd3-bf27-a17889d847b7 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1b36550>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.393035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50e73e4b-936f-4bd3-bf27-a17889d847b7 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 200 len: 354 microversion: 2.1 time: 0.114584 Sep 09 12:12:45.394569 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:45.424576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e3189f9-6731-4a7b-bec6-469c39af2fe5 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1abd8b0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.586842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f670d7f0-4a61-4d3d-a00a-1b2135555239 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abd1f0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.630928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e3189f9-6731-4a7b-bec6-469c39af2fe5 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 202 len: 0 microversion: 2.1 time: 0.218152 Sep 09 12:12:45.631527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:12:45 2022] DELETE /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:45.644067 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f4f2163-fbe3-46b3-97ba-603248ddbb9b tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1abd1f0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.717586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f670d7f0-4a61-4d3d-a00a-1b2135555239 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 287 microversion: 2.1 time: 0.134664 Sep 09 12:12:45.718308 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:45.762534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7f4f2163-fbe3-46b3-97ba-603248ddbb9b tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 200 len: 353 microversion: 2.1 time: 0.125977 Sep 09 12:12:45.763519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:46.733163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b0d53cb1-44db-4c96-bd28-b62e9a9e261e tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b36310>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:46.780807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a5c81c5d-d161-46f3-8392-9f533dae5a6e tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1b37430>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:46.818466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b0d53cb1-44db-4c96-bd28-b62e9a9e261e tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 287 microversion: 2.1 time: 0.092573 Sep 09 12:12:46.819577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:46 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:46.927269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a5c81c5d-d161-46f3-8392-9f533dae5a6e tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 200 len: 353 microversion: 2.1 time: 0.153591 Sep 09 12:12:46.928228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:46 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:47.831185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f0370413-f412-47b9-92f6-c1b0ca3f4a31 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b369d0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:47.900182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f0370413-f412-47b9-92f6-c1b0ca3f4a31 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 288 microversion: 2.1 time: 0.072594 Sep 09 12:12:47.907780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:47 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:47.913264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4e7862d6-e2a5-4a54-b827-d24146ebe0ca tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b37a60>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:47.942363 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0967822e-736e-405e-9af2-039c5d5f2a19 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Calling method '.version_select at 0x7f6bd1abd5e0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:48.090231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4e7862d6-e2a5-4a54-b827-d24146ebe0ca tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 202 len: 0 microversion: 2.1 time: 0.180052 Sep 09 12:12:48.091628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Sep 9 12:12:47 2022] DELETE /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:48.102238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-48ee9c48-ce80-4065-979f-2c8e4f7133b3 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abd430>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:48.127063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-0967822e-736e-405e-9af2-039c5d5f2a19 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] HTTP exception thrown: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0967822e-736e-405e-9af2-039c5d5f2a19 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Request method failure captured: Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c HTTP/1.1 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy24IgSXYT0Od9dGfyF1SJujU9TmSSO8ujepqHrQAzP4TpmxYYk4zsPxiaqCm9-zKKcUORER9NsfBTSmgOuVa67QBamqMuhxgpvswAH9Hfl5EcHqRvi-2hkyg62APlopbaaoU_4-2BuyGuZVgPAaL0mOkOy-56eaA6OaiqSYOX3Sxyo Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 9eaebfb93fb4475199e5cd07dba0be64 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesGetTestJSON-3027529 Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:12:48.132588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9eaebfb93fb4475199e5cd07dba0be64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9eaebfb93fb4475199e5cd07dba0be64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9eaebfb93fb4475199e5cd07dba0be64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9eaebfb93fb4475199e5cd07dba0be64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesGetTestJSON-3027529 Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 9eaebfb93fb4475199e5cd07dba0be64 Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesGetTestJSON-3027529 Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesGetTestJSON-3027529-project Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: eac115bcbe744580ab33480c53ff95af Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesGetTestJSON-3027529-project Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '568eeff0-14fb-4e17-98f7-ee404ae0485c'} Sep 09 12:12:48.133597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. (HTTP 404) (Request-ID: req-af1aebb0-89fe-4409-be44-4a5826ae5977) Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:48.134186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:48.135064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:12:48.135934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. Sep 09 12:12:48.137346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:48.140691 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0967822e-736e-405e-9af2-039c5d5f2a19 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] Returning 404 to user: Volume 568eeff0-14fb-4e17-98f7-ee404ae0485c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:48.141825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0967822e-736e-405e-9af2-039c5d5f2a19 tempest-VolumesGetTestJSON-3027529 tempest-VolumesGetTestJSON-3027529-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c" status: 404 len: 109 microversion: 2.1 time: 0.204016 Sep 09 12:12:48.144746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 10/19] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:47 2022] GET /compute/v2.1/os-volumes/568eeff0-14fb-4e17-98f7-ee404ae0485c => generated 109 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:48.218589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-88629e10-e144-4d8c-a6d9-e54d5a5e324a tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1abdaf0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:48.256894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-48ee9c48-ce80-4065-979f-2c8e4f7133b3 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 200 len: 287 microversion: 2.1 time: 0.159381 Sep 09 12:12:48.257966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:48 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 287 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:48.372340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-88629e10-e144-4d8c-a6d9-e54d5a5e324a tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ddf86643-6c90-49df-97b1-45b11a741c91" status: 200 len: 350 microversion: 2.1 time: 0.158753 Sep 09 12:12:48.374036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 11/21] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:48 2022] GET /compute/v2.1/os-volumes/ddf86643-6c90-49df-97b1-45b11a741c91 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:49.272593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e751e27f-060b-4755-8157-94ad7acd0a60 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1b37e50>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:49.332073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-e751e27f-060b-4755-8157-94ad7acd0a60 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] HTTP exception thrown: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e751e27f-060b-4755-8157-94ad7acd0a60 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Request method failure captured: Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 HTTP/1.1 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy23p4DT4LQ_bzYFCsFN_FaBsY-GOLr2ggUPoNaPB751DsM_7q3xwXk8_OXIB1DEcFU63pPZEreroB2XlziA8Ha7c9YNA0vbaJ5Tygn5NS6STEwC6DnB0elXWNPh9y7cG1n0USbax18eTio0uKNqHzFlVZg0KsnakqfTjNZJsibCxVg Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:12:49.337234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5cc0bd37a3024948b849e396014778e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: d3e5d2cb984744b3acd4e9445fe7e248 Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'b93a8166-074e-4c68-9461-5484ed9aeeb1'} Sep 09 12:12:49.338216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. (HTTP 404) (Request-ID: req-634e4ad7-36ee-47e9-b1ac-8f56fd88e2e5) Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.338839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:49.340678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 12:12:49.341603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e751e27f-060b-4755-8157-94ad7acd0a60 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Returning 404 to user: Snapshot b93a8166-074e-4c68-9461-5484ed9aeeb1 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:49.344940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e751e27f-060b-4755-8157-94ad7acd0a60 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1" status: 404 len: 111 microversion: 2.1 time: 0.071904 Sep 09 12:12:49.349177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a8d11987-b3d2-4948-b3f0-e63581c9e3e5 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1aa9280>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:49.355894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Sep 9 12:12:49 2022] GET /compute/v2.1/os-snapshots/b93a8166-074e-4c68-9461-5484ed9aeeb1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:49.540343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a8d11987-b3d2-4948-b3f0-e63581c9e3e5 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 202 len: 0 microversion: 2.1 time: 0.195380 Sep 09 12:12:49.540938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:12:49 2022] DELETE /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:12:49.551669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dcd0f7b4-4ebd-41f5-8b3f-63c31ed1751f tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd2482820>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:49.669859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dcd0f7b4-4ebd-41f5-8b3f-63c31ed1751f tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 200 len: 345 microversion: 2.1 time: 0.123337 Sep 09 12:12:49.670831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:49 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:50.686630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-78a42e65-fe64-47b6-b90f-e16c65a359de tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abdb80>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:50.825476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-78a42e65-fe64-47b6-b90f-e16c65a359de tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 200 len: 345 microversion: 2.1 time: 0.144706 Sep 09 12:12:50.826241 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:50 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:51.509231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1761649069", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:51.647957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] validate_networks() for [('65714226-b20a-40f8-a3ab-67b8f1e1b80d', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:12:51.844895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d62c5206-41d7-4da0-bbc7-cdfb8eb8ce2f tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1aa9310>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:52.029617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d62c5206-41d7-4da0-bbc7-cdfb8eb8ce2f tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 200 len: 345 microversion: 2.1 time: 0.192647 Sep 09 12:12:52.030679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:51 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:52.585998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2fb75b58-a216-4e21-b74a-39b95f74c97b tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1aa9a60>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:52.674581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2fb75b58-a216-4e21-b74a-39b95f74c97b tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4b6d3977-9700-4e33-b749-12fdf8ecd285" status: 200 len: 351 microversion: 2.1 time: 0.092366 Sep 09 12:12:52.676660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:52 2022] GET /compute/v2.1/os-volumes/4b6d3977-9700-4e33-b749-12fdf8ecd285 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:52.690805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a4a86a4e-a20a-4464-a798-e8a9fdc8d2dd tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1aa9e50>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:52.940193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a4a86a4e-a20a-4464-a798-e8a9fdc8d2dd tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.252990 Sep 09 12:12:52.940842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 16/28] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Sep 9 12:12:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:12:52.970546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79bc946a-48b5-43f5-be4d-8f8428b88e2a tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1aa9a60>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:53.228826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-79bc946a-48b5-43f5-be4d-8f8428b88e2a tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.269247 Sep 09 12:12:53.229460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1149 bytes} [Fri Sep 9 12:12:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:53.234216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6ad210e8-4946-4d0a-92b1-b1675dfe6bc8 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1abdd30>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:53.300499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-6ad210e8-4946-4d0a-92b1-b1675dfe6bc8 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] HTTP exception thrown: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6ad210e8-4946-4d0a-92b1-b1675dfe6bc8 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Request method failure captured: Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb HTTP/1.1 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy23p4DT4LQ_bzYFCsFN_FaBsY-GOLr2ggUPoNaPB751DsM_7q3xwXk8_OXIB1DEcFU63pPZEreroB2XlziA8Ha7c9YNA0vbaJ5Tygn5NS6STEwC6DnB0elXWNPh9y7cG1n0USbax18eTio0uKNqHzFlVZg0KsnakqfTjNZJsibCxVg Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:12:53.302590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5cc0bd37a3024948b849e396014778e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: d3e5d2cb984744b3acd4e9445fe7e248 Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '58955b58-2d60-4469-823c-76f97f8a2fbb'} Sep 09 12:12:53.303636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. (HTTP 404) (Request-ID: req-0a140d84-5672-44ab-baf2-5bfab9b8b2eb) Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.304347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:53.305230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:12:53.309101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6ad210e8-4946-4d0a-92b1-b1675dfe6bc8 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Returning 404 to user: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6ad210e8-4946-4d0a-92b1-b1675dfe6bc8 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 404 len: 109 microversion: 2.1 time: 0.073533 Sep 09 12:12:53.312277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 18/30] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:53 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:53.312976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-60eeb356-2b9d-4a5e-8a54-3a4e65495426 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1abddc0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:53.603460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-60eeb356-2b9d-4a5e-8a54-3a4e65495426 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.297214 Sep 09 12:12:53.604037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 19/31] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Sep 9 12:12:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:53.610659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9b7481d8-ae49-4671-83fb-989c61f341b1 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1aa9c10>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:53.667838 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-9b7481d8-ae49-4671-83fb-989c61f341b1 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] HTTP exception thrown: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9b7481d8-ae49-4671-83fb-989c61f341b1 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Request method failure captured: Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb HTTP/1.1 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy23p4DT4LQ_bzYFCsFN_FaBsY-GOLr2ggUPoNaPB751DsM_7q3xwXk8_OXIB1DEcFU63pPZEreroB2XlziA8Ha7c9YNA0vbaJ5Tygn5NS6STEwC6DnB0elXWNPh9y7cG1n0USbax18eTio0uKNqHzFlVZg0KsnakqfTjNZJsibCxVg Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:12:53.670225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5cc0bd37a3024948b849e396014778e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: d3e5d2cb984744b3acd4e9445fe7e248 Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '58955b58-2d60-4469-823c-76f97f8a2fbb'} Sep 09 12:12:53.671319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. (HTTP 404) (Request-ID: req-f2bcc5e0-2b8f-47dd-8ffc-ffb12010b344) Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.672032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:12:53.672902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:12:53.673990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:53.675193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:53.679278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9b7481d8-ae49-4671-83fb-989c61f341b1 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Returning 404 to user: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:53.680395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9b7481d8-ae49-4671-83fb-989c61f341b1 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 404 len: 109 microversion: 2.1 time: 0.075377 Sep 09 12:12:53.687813 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 20/32] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:12:53 2022] DELETE /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:53.878111 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:12:53.879646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:12:53.880292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:12:53.880848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:12:53.881412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:12:53.956126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:53.956567 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:53.957003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:53.963416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:53.966125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:53.966825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:54.090398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:54.112346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for user 31411178e5c342b7bb14a21dec62f540 and project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:54.126135 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e32574d-e4f9-4783-bee2-1188d0fcd9a4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: .version_select at 0x7f6bd1ab23a0>, body: {"keypair": {"name": "tempest-keypair-1844566760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP900SFor8OMKoOF6gL6d2YfptXaBBQyMdzU0cMl3JLgLyFLAF+fQwlvslvGdCeT5J3X+xkqukjnAmPUByaWZ/o+1PBhMgIoWIZLavOBt1rw5tuIFfKxWv5o2Y9w8+uimQ=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:54.159020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:12:54.166390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:12:54.283709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-5e32574d-e4f9-4783-bee2-1188d0fcd9a4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:54.303468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-5e32574d-e4f9-4783-bee2-1188d0fcd9a4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:54.403528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-259c0c19-63fc-4820-b7d3-6cf1a258edf7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.237883 Sep 09 12:12:54.407786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 13/33] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:12:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:12:54.424499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3fac14fa-8592-40c6-a390-6e9622bfbe61 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd19b20d0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:54.458756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e32574d-e4f9-4783-bee2-1188d0fcd9a4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.764035 Sep 09 12:12:54.466340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 21/34] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:12:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:54.472173 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-15e1db88-06f3-4268-8170-783b0cd62af6 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Calling method '.version_select at 0x7f6bd1a37280>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:54.633948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3fac14fa-8592-40c6-a390-6e9622bfbe61 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223881 Sep 09 12:12:54.635114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 14/35] 10.222.0.49 () {58 vars in 1167 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:54.655751 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-27498193-0b42-4b3d-b5f4-7d7bf2f0fe66 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:54.656516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-27498193-0b42-4b3d-b5f4-7d7bf2f0fe66 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:54.740930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-15e1db88-06f3-4268-8170-783b0cd62af6 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] HTTP exception thrown: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-15e1db88-06f3-4268-8170-783b0cd62af6 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Request method failure captured: Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb HTTP/1.1 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy23p4DT4LQ_bzYFCsFN_FaBsY-GOLr2ggUPoNaPB751DsM_7q3xwXk8_OXIB1DEcFU63pPZEreroB2XlziA8Ha7c9YNA0vbaJ5Tygn5NS6STEwC6DnB0elXWNPh9y7cG1n0USbax18eTio0uKNqHzFlVZg0KsnakqfTjNZJsibCxVg Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:12:54.756997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5cc0bd37a3024948b849e396014778e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5cc0bd37a3024948b849e396014778e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 5cc0bd37a3024948b849e396014778e9 Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-441921240 Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: d3e5d2cb984744b3acd4e9445fe7e248 Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-441921240-project Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '58955b58-2d60-4469-823c-76f97f8a2fbb'} Sep 09 12:12:54.758238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. (HTTP 404) (Request-ID: req-39f48a46-eb3a-46f1-8ccf-7e387d2b1193) Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:54.759004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:12:54.759866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:12:54.760778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. Sep 09 12:12:54.761669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:12:54.773268 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-15e1db88-06f3-4268-8170-783b0cd62af6 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] Returning 404 to user: Volume 58955b58-2d60-4469-823c-76f97f8a2fbb could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:54.791391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-15e1db88-06f3-4268-8170-783b0cd62af6 tempest-VolumesSnapshotsTestJSON-441921240 tempest-VolumesSnapshotsTestJSON-441921240-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb" status: 404 len: 109 microversion: 2.1 time: 0.306734 Sep 09 12:12:54.798024 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 22/36] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/os-volumes/58955b58-2d60-4469-823c-76f97f8a2fbb => generated 109 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:54.818043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-da661318-0d8d-45b3-afb6-828fa15ed7bf tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1a371f0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:55.217459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-da661318-0d8d-45b3-afb6-828fa15ed7bf tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.412758 Sep 09 12:12:55.218354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-27498193-0b42-4b3d-b5f4-7d7bf2f0fe66 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:55.218718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 23/37] 10.222.0.49 () {58 vars in 1170 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:55.241586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-587ddc84-03e0-4c27-8e74-b44a52a64982 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd19c48b0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:55.269026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-27498193-0b42-4b3d-b5f4-7d7bf2f0fe66 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1222 microversion: 2.1 time: 0.631997 Sep 09 12:12:55.269610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 15/38] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1222 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:55.619246 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-587ddc84-03e0-4c27-8e74-b44a52a64982 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.388848 Sep 09 12:12:55.620806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 24/39] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Sep 9 12:12:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:55.636213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-83d7afaf-c97a-4ad1-80d3-43f91f3e8afb tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd1abd430>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:55.656122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-669493825", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:55.927866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] validate_networks() for [('65714226-b20a-40f8-a3ab-67b8f1e1b80d', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:12:55.934306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-83d7afaf-c97a-4ad1-80d3-43f91f3e8afb tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.303180 Sep 09 12:12:55.935252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 16/40] 10.222.0.49 () {58 vars in 1188 bytes} [Fri Sep 9 12:12:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:55.954327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-37bae19d-2606-4511-ab4c-07b40ccb99d8 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] Calling method '.version_select at 0x7f6bd115f550>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:56.145037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-37bae19d-2606-4511-ab4c-07b40ccb99d8 tempest-VolumesTestJSON-1575590978 tempest-VolumesTestJSON-1575590978-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.193991 Sep 09 12:12:56.145913 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 17/41] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Sep 9 12:12:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:57.048068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-314175149", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "networks": [{"uuid": "1ca4b533-250a-48a2-a1ac-c8d75631d94b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:57.156590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] validate_networks() for [('1ca4b533-250a-48a2-a1ac-c8d75631d94b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:12:59.999476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:00.000294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:00.001388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:00.002045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:00.002695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:00.031287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.032026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.032472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.037212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.037898 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.038501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.103365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:00.117205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for user 31411178e5c342b7bb14a21dec62f540 and project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:00.180612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:00.190045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:00.253173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:00.253650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:00.254059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:00.254472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:00.254883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:00.283580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.290406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.290959 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.294849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.295454 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.298401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.356962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Getting quotas for project 433140f4c010464fa04a5622b26bc3ab. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:00.371939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Getting quotas for user ab948442f326433c8e9f5f90314627aa and project 433140f4c010464fa04a5622b26bc3ab. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:00.399761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:00.409296 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:00.411601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-20fedad6-2083-4c87-8cb8-6e2693b2d9dd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.760118 Sep 09 12:13:00.427819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 25/42] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:12:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 4777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:13:00.448262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-035fbbb6-b954-4ced-a294-d14a9fd801eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:00.449243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-035fbbb6-b954-4ced-a294-d14a9fd801eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:00.593840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-18ec44b7-9eb1-4d76-9719-eb81ccfcc383 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.847338 Sep 09 12:13:00.601194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 18/43] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:13:00.617712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cfe00cea-80c1-419d-afc8-1213181df749 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:00.618827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cfe00cea-80c1-419d-afc8-1213181df749 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:00.717798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-035fbbb6-b954-4ced-a294-d14a9fd801eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:00.765564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-035fbbb6-b954-4ced-a294-d14a9fd801eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1221 microversion: 2.1 time: 0.335913 Sep 09 12:13:00.769294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 26/44] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:00 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1221 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:01.027391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cfe00cea-80c1-419d-afc8-1213181df749 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:01.040199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cfe00cea-80c1-419d-afc8-1213181df749 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1214 microversion: 2.1 time: 0.427953 Sep 09 12:13:01.042074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 19/45] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:00 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:01.798176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1597b6a8-957d-498b-a83f-a70194525cbb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:01.799220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1597b6a8-957d-498b-a83f-a70194525cbb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:02.077613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:02.078780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:02.101070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:02.105985 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:02.110186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:02.113331 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:02.113900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:02.117848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:02.206078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1597b6a8-957d-498b-a83f-a70194525cbb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:02.222565 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1597b6a8-957d-498b-a83f-a70194525cbb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1221 microversion: 2.1 time: 0.429678 Sep 09 12:13:02.226087 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 27/46] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:01 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1221 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:02.250065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1144713189", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2"}], "security_groups": [{"name": "tempest-securitygroup--1426662058"}], "key_name": "tempest-keypair-1844566760", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:04.232658 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:04.254784 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] validate_networks() for [('8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:13:04.295350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b7bc2cfd-9c8b-44bb-94de-a1b21b06ba9e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1210 microversion: 2.1 time: 2.220932 Sep 09 12:13:04.347442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 20/47] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:02 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1210 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:04.376579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:04.378109 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:04.413521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.414805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.415599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.417422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.418232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.418857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.803528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:04.822477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-73d7682a-def6-45ae-a1c6-d312a6b52df4 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1273 microversion: 2.1 time: 0.469846 Sep 09 12:13:04.832473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 21/48] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:04 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1273 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:05.355221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:05.358516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:05.395504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:05.396939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:05.398152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.399388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:05.400250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:05.413723 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.959751 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:05.988711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-89276db6-62db-4af9-a759-08ff5f6e7f6b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1272 microversion: 2.1 time: 0.637310 Sep 09 12:13:06.009449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 22/49] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:05 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1272 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:06.031146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:06.032167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:06.054599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.055453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.056461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.058695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.062462 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.064611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.612290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:06.653561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ceed5cdb-b06d-472b-8b2d-3ffdea3d5c22 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1279 microversion: 2.1 time: 0.626363 Sep 09 12:13:06.663061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 23/50] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:06 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1279 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:07.045300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:07.046068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:07.067285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.068300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.075655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.087442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.088662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.091427 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.805474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:07.806630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:07.807566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:07.808193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:07.808952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:07.820747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.821396 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.821978 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.824186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.824841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.825530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.849041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:07.855904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:07.874045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:07.877792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:08.011526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e0bd3c20-7d4d-477a-b456-577dde1f157a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.781926 Sep 09 12:13:08.015303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 28/51] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:13:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 5788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:13:08.360082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:08.368979 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-da82478d-97e5-4bf3-ac0c-545776dc6c49 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 1.328358 Sep 09 12:13:08.395630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 24/52] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:07 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:08.413291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:08.413924 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:08.436090 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:08.436615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:08.437068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:08.437795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:08.438259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:08.438691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:08.616757 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fa3e6aab-c018-442b-a3e7-dcdeb36523ef tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: .version_select at 0x7f6bd11045e0>, body: {"keypair": {"name": "tempest-keypair-1605139091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzpKT7/jmsu0X06ByI19VAi/3CNYLmS4lTeL67OMDKRorNPfVZDii7jISjh2L1a3DLoSMkD34kDTmHfeYLX74KBkAniRlv71C2uHR/XBnaS5IthBlZZKtsisGumSO8wEg=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:08.750009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-fa3e6aab-c018-442b-a3e7-dcdeb36523ef tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for project f2f72b6ae8d3482e935d3375bc999732. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:08.784699 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-fa3e6aab-c018-442b-a3e7-dcdeb36523ef tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for user b9a5c9fb3f664ae097f0c3ce6f6c0764 and project f2f72b6ae8d3482e935d3375bc999732. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:08.899502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fa3e6aab-c018-442b-a3e7-dcdeb36523ef tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.879717 Sep 09 12:13:08.902651 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 29/53] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Sep 9 12:13:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 885 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 12:13:08.921473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e6f8efa2-8f7f-47ff-a12b-e223dc2225c6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:08.925090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e6f8efa2-8f7f-47ff-a12b-e223dc2225c6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:09.335086 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e6f8efa2-8f7f-47ff-a12b-e223dc2225c6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:09.352514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e6f8efa2-8f7f-47ff-a12b-e223dc2225c6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1242 microversion: 2.1 time: 0.442728 Sep 09 12:13:09.354116 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 30/54] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:08 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1242 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:09.412185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:09.412807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:09.426655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.430528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.431283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:09.433399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.436142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.437929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.328494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:11.037661 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=16 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:11.091544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:11.126240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ae1156e0-8dec-4324-8cd5-b1741f20b888 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 2.729040 Sep 09 12:13:11.128447 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 25/55] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:08 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:11.151945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:11.157685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:11.201026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:11.203798 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:11.205316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:11.207265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:11.212057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:11.215403 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:11.374140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:11.409190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1ac759a5-612c-4e4c-952f-710ab3240d19 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 1.998782 Sep 09 12:13:11.410051 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 31/56] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:09 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:11.626135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:11.654613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-777155fe-564d-4646-97f1-486defc027da tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1294 microversion: 2.1 time: 0.521300 Sep 09 12:13:11.656409 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 26/57] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:11 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1294 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:12.155380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:12.156231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:12.190461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:12.196158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:12.196744 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:12.200227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:12.200718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:12.201221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:12.434085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:12.434809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:12.452495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:12.454383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:12.455833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:12.457606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:12.459812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:12.461414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:12.941490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:12.954234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed3a0339-c469-47cf-bf22-32f7417176ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.803835 Sep 09 12:13:12.955366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 32/58] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:12 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:13.063210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2577d93-3497-429f-8fdd-f2376217b20c", "tag": "7e0b4dad-c154-432b-883f-3ce55a1b59c2"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:13.097234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.099500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.101745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.126196 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:13.158436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1679e7f5-6e50-440a-a498-38aa4511a824 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.728218 Sep 09 12:13:13.174713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 27/59] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:12 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:13.184519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:13.185150 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:13.210216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.211220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.212059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.214548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Creating event network-changed:7e0b4dad-c154-432b-883f-3ce55a1b59c2 for instance b2577d93-3497-429f-8fdd-f2376217b20c on hv-cinder-85221 Sep 09 12:13:13.215369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.216043 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.217357 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.218600 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:13:13.219176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-de9b17be-2567-4695-bcb4-7764b8956e84 req-ae033492-3ca8-4635-8ac7-291aad90c552 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:13:13.220561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.221182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.221761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.222800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.223554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.224151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.237564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.compute.rpcapi [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:13:13.239353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] Releasing lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:13:13.264768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-84d91cee-bb27-474f-a2f3-835f3057dd33 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306252 Sep 09 12:13:13.266057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 33/60] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:13.415407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:13.429107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-743edb96-3452-45bc-bab1-8b3ab98e41cb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1300 microversion: 2.1 time: 0.257223 Sep 09 12:13:13.429698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 28/61] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:13 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:13.906134 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bf6d84-bbe7-47cd-90f4-21b3a6eef971", "tag": "dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:13.929298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:13.933467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:13.933974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:13.954178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] Creating event network-changed:dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e for instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 on hv-cinder-85221 Sep 09 12:13:13.961905 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6cb9d696-2401-4f7e-bb2a-4f8c33a430f9 req-54266ef6-bfea-4ca6-9b3d-e956a94de785 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499772 Sep 09 12:13:13.963958 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 34/62] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:13.987308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:13.988239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:13.998509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.000988 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.004860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.006022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.052181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.058173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.184174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:14.185119 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:14.205975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.206477 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.206932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.213409 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.214236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.215112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.451995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:14.465850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e9111b5-60e5-4b36-a0ee-f66dcb3e6d65 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.485286 Sep 09 12:13:14.473963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:13 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:14.482379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:14.483968 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:14.492489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.493190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.493770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.501588 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:14.502497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:14.503171 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:14.566628 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:14.579447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-44328b05-328e-4d7c-beae-ad8931e3b60e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.400787 Sep 09 12:13:14.587654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:14 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:14.672919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:14.684950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5b08b137-1a32-4340-8db2-1400a9668728 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1300 microversion: 2.1 time: 0.206624 Sep 09 12:13:14.686235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 30/65] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:14 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:14.911204 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1467475482", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ee3e7ed-1f23-4a3e-baef-1657fb65ad87"}], "security_groups": [{"name": "tempest-securitygroup--1324036506"}], "key_name": "tempest-keypair-1605139091", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:15.068364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] validate_networks() for [('9ee3e7ed-1f23-4a3e-baef-1657fb65ad87', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:13:15.305412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2e2ea8-b146-4e6a-a71b-254e88b3275b", "tag": "ae6e01ce-10c2-4dd8-b58a-1c3b79142a91"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:15.342084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.343082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.343740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.386259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Creating event network-changed:ae6e01ce-10c2-4dd8-b58a-1c3b79142a91 for instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b on hv-cinder-85221 Sep 09 12:13:15.391525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:13:15.392251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd8c7058-2e30-428d-9cfa-41ba26573326 req-8221d5ca-2f7a-46c5-8321-c595c1901068 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:13:15.393655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.394333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.395062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.396096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.396995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.397623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.414488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.compute.rpcapi [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:13:15.425796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] Releasing lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:13:15.464015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f44097c2-7dde-487f-bee9-caaae685c2df None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161043 Sep 09 12:13:15.466396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 31/66] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:15.500041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:15.501757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:15.538034 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.539005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.542690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.544967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.548080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.549736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.744901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:15.760703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c1f53634-1bff-4840-b2b8-aa6964922724 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.261945 Sep 09 12:13:15.761528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 32/67] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:15 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:15.773719 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:15.777415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:15.792879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.794288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.797487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.798329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.799344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.801163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.190185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:16.191219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:16.192030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:16.192449 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:16.192863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:16.205189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.205839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.206423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.207497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.208188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.208749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.244482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for project f2f72b6ae8d3482e935d3375bc999732. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:16.249916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for user b9a5c9fb3f664ae097f0c3ce6f6c0764 and project f2f72b6ae8d3482e935d3375bc999732. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:16.277037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:16.280303 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.282985 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:16.290237 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-97d76014-6a2f-4576-890e-3aaf7a3b084c tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.527545 Sep 09 12:13:16.293276 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 33/68] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:15 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:16.302999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:16.312854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:16.323569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.324591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.325472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.326984 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.328167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.328903 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.390694 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-642bba77-7d46-44d3-8f0e-2897d048d2f0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.482405 Sep 09 12:13:16.392674 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 36/69] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Sep 9 12:13:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 12:13:16.406179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:16.407642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:16.413874 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:16.522010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.531114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.533992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.535109 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b7fa5dc9-feaf-4173-b1a6-61753cccbe79 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1282 microversion: 2.20 time: 0.135037 Sep 09 12:13:16.536355 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 37/70] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:16 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:16.554732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.567145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-86c72078-9bb1-4b72-aab5-30e0e55f4e8f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1300 microversion: 2.1 time: 0.271960 Sep 09 12:13:16.567745 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 34/71] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:16 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:16.787593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:16.788203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:16.800287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.800981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.801854 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.802588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.803362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.807554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.072148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.083196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2add93d6-7167-4f2a-90ed-d95e6a58e395 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.298448 Sep 09 12:13:17.084160 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 38/72] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:16 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:17.317155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:17.317767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:17.325460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.326363 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.327120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.328258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.328862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.329438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.563907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.565193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:17.566318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:17.573949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0e3f331a-9c6f-44bd-b982-2e8eeb3a4bb0 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.260477 Sep 09 12:13:17.574932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.575309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 35/73] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:17 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:17.582693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.582693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.582693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.582693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.583230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.596482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:17.598003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:17.605391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.606566 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.607041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.607897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.608494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.609060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.614045 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:17.667982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.678151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.679681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.681187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0aab429c-1425-4a73-ae88-699fc24acd63 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1286 microversion: 2.20 time: 0.121173 Sep 09 12:13:17.683198 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 39/74] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:17 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:17.790807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.800121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0142ef89-5c8f-4bb9-a45f-69553e3a3fb9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.208154 Sep 09 12:13:17.811171 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 36/75] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:17 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:18.105395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.106008 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.111936 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.112420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.112858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.113546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.113999 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.114420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.298342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:18.308520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2ba53351-4bc2-4132-b977-4e68570c1da9 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.206755 Sep 09 12:13:18.309566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 40/76] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:18.600859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.601377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.608390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.609159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.609745 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.610650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.611278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.611948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.710110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.711132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.720784 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.723772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.724342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.726365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.727192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.730085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.830319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:18.842065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9f3efa13-9fa1-4fb7-82a7-c224c601b51d tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.245010 Sep 09 12:13:18.843161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 37/77] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:18.880948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:18.891540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.894356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.897790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:18.901610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:18.902766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b12abab9-e331-440a-8d2f-d0d392b6216a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1286 microversion: 2.20 time: 0.197515 Sep 09 12:13:18.915321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.915321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.915321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.915543 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 41/78] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:18.915708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.915708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.921403 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.186569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:19.204514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eaf559c5-ac5a-4742-8537-0e1fa71a20dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.359580 Sep 09 12:13:19.221016 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 38/79] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:19.336156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:19.337007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:19.345708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.346210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.346652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.347662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.348275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.348866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.498961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:19.508063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f9b8894b-b9ec-44a4-8a47-69bdaae9bbb2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.175435 Sep 09 12:13:19.508193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 42/80] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:19 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:19.873413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:19.874660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:19.881234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.881792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.882294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.883187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.883637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.884056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.937212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:19.937972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:19.944799 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.945537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.946126 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.947218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:19.948127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:19.948703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.064644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.099279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.101152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.102298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-64bfe74d-9976-41b7-9d80-80c21ffd14ee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1286 microversion: 2.20 time: 0.171236 Sep 09 12:13:20.103042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 43/81] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:19 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:20.233489 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:20.234181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:20.246678 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.247519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.248136 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.249291 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.250059 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.251040 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.332660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.341640 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-36048133-2e1b-41c7-bd45-aa88b8f9b7f7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.473132 Sep 09 12:13:20.342409 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 39/82] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:19 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:20.532061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:20.532911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:20.539934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.541587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.542369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.543352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.543965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.544595 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.601306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.619803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50f490e6-8111-4a9f-bfbe-5cd614854f22 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.393334 Sep 09 12:13:20.620447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 44/83] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:20 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:21.130509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:21.131992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:21.144235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.144836 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.145441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.147002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.147122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.148005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.164054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=73 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:21.284045 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.292724 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1093b19e-657f-4d2a-b87d-a39fc7072cac tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.764562 Sep 09 12:13:21.293576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 40/84] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:20 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:21.360960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.367522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:21.368294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:21.379470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.382164 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:21.385416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.392212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.393537 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.394524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.396214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.396783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.398211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6b643f9d-f791-4f8c-a7b0-20d4d325b6f7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1342 microversion: 2.20 time: 0.271897 Sep 09 12:13:21.398918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.402207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 45/85] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:21 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1342 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:21.653526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:21.654290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:21.661375 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.662349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.662972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.664007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.664656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.665244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.729583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.737644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-69bba308-b037-4630-924f-2d726aac3ff4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.375307 Sep 09 12:13:21.738562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 41/86] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:21 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:22.011926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:22.026087 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-329246f6-0e70-4bc2-b84e-440dd827221c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.376608 Sep 09 12:13:22.029795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 46/87] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:21 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:22.270386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0cb5c6-89f6-4231-8311-7ddbe2693c70", "tag": "87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:22.283438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.284190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.288853 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.317396 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:22.319378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:22.346515 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.348076 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.349234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.350258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.352048 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.352701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.357106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] Creating event network-changed:87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d for instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 on hv-cinder-85221 Sep 09 12:13:22.367138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-e756e31e-2784-4653-af01-6784610a45ed req-162946e8-e037-44ee-8cc9-04bbb3f7747c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098082 Sep 09 12:13:22.370980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 42/88] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:22.429940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:22.431256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:22.438762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.439789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.440707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.441660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.442522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.443489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.553055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:22.566804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:22.569680 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:22.571204 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2aa7376d-554e-4b82-a8ea-75a05f902cde tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1340 microversion: 2.20 time: 0.146791 Sep 09 12:13:22.588447 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 43/89] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:22 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1340 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:22.614311 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:22.662501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-057773f6-0ec4-48e9-96d7-8f890e1339b6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.348854 Sep 09 12:13:22.669338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 47/90] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:22 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:22.763894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:22.764752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:22.774428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.775089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.775586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.776238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.780169 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.780655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:23.053592 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:23.054261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:23.062581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:23.063376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:23.063980 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:23.064841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:23.065448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:23.066021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:23.989628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.001336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4a00b11a-2196-495a-9fbd-f1548c70444b tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 1.241587 Sep 09 12:13:24.001895 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 44/91] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:22 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:24.017900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:24.018522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:24.045795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:24.046486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:24.047962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:24.052003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:24.053065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:24.053845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:24.224570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.236246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.252532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.253762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-378a4b9e-6bb4-4ddd-90b4-39b7703c1d19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1340 microversion: 2.20 time: 0.247525 Sep 09 12:13:24.254341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 45/92] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:24 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1340 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:24.288162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:24.288800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:24.295051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:24.295549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:24.295998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:24.296703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:24.303210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:24.303928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:24.636720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.650970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7c4b9d31-7e81-4f80-a6e5-f42eae23ac6c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 1.601071 Sep 09 12:13:24.651566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 48/93] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:23 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:24.796575 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:24.807676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a2098976-8f54-4228-955b-3f69d04362ff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.539503 Sep 09 12:13:24.809531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 46/94] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:24 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:25.024492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:25.025848 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:25.033755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.034516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.034986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.035693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.036147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.036849 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.244635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:25.254668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dff0d5f9-7dfa-446e-bed2-e6dcf9a1255e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.233749 Sep 09 12:13:25.260544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 49/95] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:25 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:25.289198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:25.289980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:25.326159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.330796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.331327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.334069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.335025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.336689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.424216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:25.673851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:25.674473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:25.685868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.688774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.689636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.694132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.699803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.702795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.805280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:25.817390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:25.818927 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:25.833954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-753b53ff-c2fa-47f9-9335-77dbf4f392b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.547993 Sep 09 12:13:25.848020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 47/96] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:25 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:25.860659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:25.870607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:25.890277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.890771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.891243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:25.891945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:25.892399 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:25.892858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.189126 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:26.201586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-933bacee-c500-471c-874c-f391f8523b67 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.531391 Sep 09 12:13:26.214937 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 50/97] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:25 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:26.234012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=8 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:26.239864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:26.247941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-415eb444-16cc-43b1-82e0-afd6aaf9a734 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.398731 Sep 09 12:13:26.259040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 48/98] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:25 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:26.284090 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:26.284784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:26.292388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.293849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.294568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.295765 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.296983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.297703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.527046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=34 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:26.539998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:26.548929 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2c2de90b-0164-47c5-a6c4-a386ac99f691 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.268748 Sep 09 12:13:26.549503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 49/99] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:26 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:26.554094 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:26.564195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.565126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.566110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.579134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] Creating event network-changed:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:13:26.581870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2577d93-3497-429f-8fdd-f2376217b20c", "name": "network-vif-plugged", "status": "completed", "tag": "7e0b4dad-c154-432b-883f-3ce55a1b59c2"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:26.584342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-8488fdcc-0070-4b45-b4e2-146cc08bb30b req-1dc0a377-10ae-4989-b911-d7dee9bd580a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033482 Sep 09 12:13:26.584894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 50/100] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:26.596747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.597230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.597656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.609929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] Creating event network-vif-plugged:7e0b4dad-c154-432b-883f-3ce55a1b59c2 for instance b2577d93-3497-429f-8fdd-f2376217b20c on hv-cinder-85221 Sep 09 12:13:26.615632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-5ec27a48-3d67-42d8-9351-4867a9234614 req-8c1f7438-4ac1-4abe-8dd1-bee88c745262 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409155 Sep 09 12:13:26.616772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 51/101] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:26.864933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:26.865729 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:26.872817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.873300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.874115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.875486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.876240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.877044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.069960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.079672 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.081268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.082317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-88309ca5-7279-4083-ad68-f364ca1c531c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.222416 Sep 09 12:13:27.083203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 51/102] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:26 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:27.230701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:27.231947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:27.239513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.240348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.241068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.242397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.243068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.244328 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.274598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:27.275446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:27.284972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.287087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.289828 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.291654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.305670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.307200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.514855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.520887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.525366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a4aa1407-bd36-4efa-9041-19436874f4d8 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.298938 Sep 09 12:13:27.526226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:27 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:27.544699 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-013d4144-06e5-48f8-9940-ede60e2f2bec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.274945 Sep 09 12:13:27.545287 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:27 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:27.574192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:27.574829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:27.581415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.581896 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.582322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.583027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.583472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.584058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.732583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:27.741274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d11ee8eb-3751-46a5-9e06-590eb951d799 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.171638 Sep 09 12:13:27.746595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 53/105] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:27 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:28.116521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:28.117554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:28.123932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.124428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.124874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.125587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.126210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.126762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.305929 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.316525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.318335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.320137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f701ae08-eeef-4c6a-94d8-7d7276cbf68d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.208404 Sep 09 12:13:28.321167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 53/106] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:28 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:28.548920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:28.549591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:28.555578 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.556069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.556508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.557193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.557647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.558075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.568590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:28.569134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:28.575339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.575823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.576284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.576971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.577422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.577838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.581956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:28.758223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.763424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.766828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a0a7449d-9680-4645-8be5-5c89fa0de108 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.221709 Sep 09 12:13:28.767431 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 54/107] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:28 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:28.771322 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-165d0461-5593-4169-b49f-b0aed0f197f5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.206431 Sep 09 12:13:28.771835 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:28.772433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:28.777511 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 54/108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:28 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:28.779247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.779731 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.780162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.780843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:28.781297 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:28.781711 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.908199 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.916330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-316bb95c-768d-46c2-978f-9114c892fbb8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.147967 Sep 09 12:13:28.916896 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 55/109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:28 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:29.347596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:29.348208 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:29.355224 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.355713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.356152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.356849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.357325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.357806 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.513483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.521623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.523105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.524209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e364b38-13bf-407c-9757-c0b672e84b19 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.180516 Sep 09 12:13:29.525769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 55/110] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:29 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:29.789523 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:29.790277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:29.793802 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:29.794549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:29.796337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.796818 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.797244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.797926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.798372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.798789 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.800338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.800819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.801251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.801928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.802375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.802791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.991577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.994909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.999765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-695a01d4-de38-44e0-892f-98705887e565 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.214203 Sep 09 12:13:30.000339 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 56/111] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:29 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:30.002677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-28f40713-ed31-4de2-96b5-548f77d9f43f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.212826 Sep 09 12:13:30.006819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 56/112] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:29 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:30.006983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:30.006983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:30.011689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.012176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.012610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.013312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.013767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.014239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.153931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:30.162547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b988b035-c700-46cd-aabd-3831791b4170 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.161189 Sep 09 12:13:30.163164 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 57/113] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:30 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:30.549470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:30.550079 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:30.556295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.556777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.557238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.557921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.558370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.558790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.687894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:30.695910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:30.697897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:30.699028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-586f975f-1d3f-49be-88f8-bba65102eb00 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.153423 Sep 09 12:13:30.699587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 57/114] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:30 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:31.023644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:31.024292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:31.025448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:31.026068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:31.030551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.031068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.031510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.031984 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.032198 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.032474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.032650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.032907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.033069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.033591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.034044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.034464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.221120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.228910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.229374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d846fc4-3639-4025-8acb-f84ace7f9e94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.209856 Sep 09 12:13:31.229961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 58/115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:31 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:31.245231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:31.245231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:31.245453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-38af050d-b09a-435f-9556-117dc7d26ecc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.215345 Sep 09 12:13:31.245453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 58/116] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:31 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:31.245611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.245611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.245611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.245611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.245900 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.245900 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.377910 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.385529 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-46390787-5edc-4dc1-8bb0-2552504de4c7 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.154648 Sep 09 12:13:31.386100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 59/117] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:31 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:31.723596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:31.724235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:31.730271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.730753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.731228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.731915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:31.732368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:31.732791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:31.863259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.871413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.872867 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:31.873973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-929e0eea-7b2a-451b-932f-8dd7c3582388 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.154271 Sep 09 12:13:31.874531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 59/118] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:31 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:32.252289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:32.253079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:32.260012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.260495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.261042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.261735 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.262249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.262370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:32.262673 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.262860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:32.268781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.269260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.269718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.270445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.270910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.271333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.480465 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:32.484670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:32.494936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e0475cf-f060-4476-bbd5-bd3b11d20598 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.236426 Sep 09 12:13:32.503039 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2c1b9726-bd01-4c9c-8666-a203de1ac540 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.248845 Sep 09 12:13:32.519173 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 60/119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:32 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:32.523244 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 60/120] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:32 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:32.528141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:32.528805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:32.553533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.553866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.554326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.555189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.556318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.556753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.902483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:32.911488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:32.920269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.934639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.935136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:32.936135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:32.936586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:32.937003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.039650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.051222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f73ace84-9250-49e8-a416-2efc2330d12a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.542642 Sep 09 12:13:33.054170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 61/121] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:32 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:33.062125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e2ea8-b146-4e6a-a71b-254e88b3275b", "name": "network-vif-plugged", "status": "completed", "tag": "ae6e01ce-10c2-4dd8-b58a-1c3b79142a91"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:33.097923 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.107966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.108943 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.136849 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] Creating event network-vif-plugged:ae6e01ce-10c2-4dd8-b58a-1c3b79142a91 for instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b on hv-cinder-85221 Sep 09 12:13:33.153971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-93e94f81-84eb-4e71-9c04-6ed0f7df069d req-0eccf9f3-7c9d-4287-91ea-036d09261dac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094612 Sep 09 12:13:33.154593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 62/122] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:33.243849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.253670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.255157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.256296 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f7460a81-0d9e-422c-94a8-55e421467256 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.360694 Sep 09 12:13:33.257315 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 61/123] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:32 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:33.529007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:33.529850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:33.533145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:33.533795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:33.536317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.536875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.537377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.538138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.538677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.539189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.540498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.541206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.541647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.542346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.542990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.543416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.543824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:33.744844 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.748533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.753020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4e778f46-4fed-4ef9-b62e-c5b919c724ae tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.228734 Sep 09 12:13:33.756415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-12bed1f3-e868-4ff8-acfd-f3da833d1ee8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.227020 Sep 09 12:13:33.756983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 62/124] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:33 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:33.767115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 63/125] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:33 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:34.077354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:34.077994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:34.083827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.084348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.084787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.085475 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.085931 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.086356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.233407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:34.241037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e83571cf-9d99-4ef4-bbad-af7f6d79c7d2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.167596 Sep 09 12:13:34.241613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 63/126] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:34 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:34.283786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:34.284395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:34.291000 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.291487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.291925 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.292621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.293076 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.293501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.436660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:34.445075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:34.447110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:34.448355 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-35938abb-c46a-471f-8766-c339d400e81d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.168396 Sep 09 12:13:34.448834 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 64/127] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:34 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:34.779293 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:34.780208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:34.782076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:34.783236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:34.786254 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.786739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.787276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.787935 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.788392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.788812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.792516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.794546 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.795191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.796229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.796697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.797140 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.001284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.003573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.009886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c616301b-6cd8-456f-a6c9-8a41b8a31019 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.235790 Sep 09 12:13:35.020793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 64/128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:34 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:35.020884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5d6db7ef-2eb6-4651-8731-e35daa3c78e2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.236903 Sep 09 12:13:35.021482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 65/129] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:34 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:35.265340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:35.266035 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:35.271957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.272382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.272820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.273515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.273973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.274960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.429152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.441013 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d5b14c2c-a1a2-44e3-a1a0-cd2147a8f7e2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.180149 Sep 09 12:13:35.441578 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 65/130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:35 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:35.473206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:35.474030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:35.482154 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.483013 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.483596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.484301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.484763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.485224 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.615421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.623945 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.625507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.626612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6fbda2b1-0f88-4b6f-9be8-09a28cb94ed3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.157466 Sep 09 12:13:35.627197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 66/131] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:35 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:36.033017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:36.033712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:36.038442 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:36.039101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:36.040889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.041400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.041848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.042714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.043405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.043871 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.048976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.049819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.050527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.051981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.053057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.053934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.413332 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.417928 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.426278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cf506dc6-f357-4573-97ad-acac90855d21 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.393199 Sep 09 12:13:36.426860 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 67/132] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:36 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:36.427525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-144caa0e-d192-48db-a56c-79377cf0c45a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.398445 Sep 09 12:13:36.428124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 66/133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:36 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:36.449196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bf6d84-bbe7-47cd-90f4-21b3a6eef971", "name": "network-vif-plugged", "status": "completed", "tag": "dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:36.458758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.459512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.459941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.465847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:36.466854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:36.473616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.474290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.474873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.475699 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] Creating event network-vif-plugged:dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e for instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 on hv-cinder-85221 Sep 09 12:13:36.476129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.476736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.478175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.482456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-9378a5d1-c684-4177-9f87-a0f2c83049c8 req-c653c54d-6427-476b-9e53-73df5dd841d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053849 Sep 09 12:13:36.483949 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 68/134] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:36.653561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:36.654230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:36.670139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.674049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.675809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.679223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.679223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.679223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.748709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.763738 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-be8144e1-1c6c-40da-97d8-9d83f19fddeb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.301576 Sep 09 12:13:36.765623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 67/135] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:36 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:36.927430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.942382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.944389 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.945704 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dfab316a-6472-4edf-bbd4-9288d850eccc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.297336 Sep 09 12:13:36.946400 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 69/136] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:36 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:37.450177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:37.451339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:37.452027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:37.452634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:37.458708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.459382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.459966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.460813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.461417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.462939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.463603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.464202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.464740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.465603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.466254 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.466863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.780062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:37.793150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:37.795264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf79a44a-8ba9-403d-91e1-0dc97dab3797 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.349329 Sep 09 12:13:37.796817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 68/137] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:37 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:37.803624 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fd958886-acf5-4d5b-ac80-358d99bb2289 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.355478 Sep 09 12:13:37.808871 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 70/138] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:37 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:37.809502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:37.812707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:37.825418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.826761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.827358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.828227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.828867 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.829299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.973384 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:37.974292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:37.983748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.984231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.984865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:37.985912 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:37.986511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:37.987130 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.245804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:38.253970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7da5a1c0-8b2f-4321-b3ea-763999d1725f tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.455767 Sep 09 12:13:38.254836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 69/139] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:37 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:38.309186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:38.317708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:38.319208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:38.320520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a137403b-4187-47e1-8b51-30de787a8fcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.351328 Sep 09 12:13:38.322317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 71/140] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:37 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:38.834714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:38.835358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:38.835501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:38.835999 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:38.845849 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.846354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.846800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.852823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.853208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.853321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.853542 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.854143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.855087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.855204 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.855783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.856753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.180104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.186836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:39.188466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.192842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6673d70f-1de2-4809-901d-ee7a9d048caf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.361878 Sep 09 12:13:39.193831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 70/141] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:38 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:39.198548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2b2ade53-fc6b-42e7-ae49-666d29c8cd36 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.367551 Sep 09 12:13:39.199359 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 72/142] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:38 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:39.279022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:39.279859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:39.285997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.286474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.286917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.287762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.288339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.288914 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.348067 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:39.348896 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:39.355776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.356274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.356792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.357707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.358214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.358630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.480892 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.490163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-12c1c87c-7e4f-4713-8112-add59cc0d29a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.216431 Sep 09 12:13:39.490732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 71/143] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:39 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:39.557587 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.566085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.567513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.568609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0856ed77-48e9-42f2-aca5-f1803fc51bee tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.224347 Sep 09 12:13:39.569157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 73/144] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:39 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:40.226669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:40.231811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:40.233540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:40.234624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:40.259819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.261693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.262451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.263193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.263870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.264802 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.265431 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.266763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.267870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.268075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.269193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.271541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.528477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.540417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d41d22bc-438d-40df-b8bf-af9d19e4a8ed tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.327186 Sep 09 12:13:40.542296 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 72/145] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:40 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:40.547493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:40.548576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:40.556662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.557525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.558292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.559335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.559931 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.560752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.564894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.575318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ebf6f138-7e73-4a47-a421-a1da091de6df tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.355064 Sep 09 12:13:40.576228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 74/146] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:40 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:40.595303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:40.596155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:40.603214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.603902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.604499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.605647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.606235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.606664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.817555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.828587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ce56db5-3016-4303-b6ac-c8e7ba6ed3bb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.284692 Sep 09 12:13:40.839916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 73/147] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:40 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:40.840038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.846863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.848364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.849428 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a2effc88-ba0c-4441-8d0b-1b644d7612b4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.258205 Sep 09 12:13:40.849980 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 75/148] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:40 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:41.565565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:41.566181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:41.573032 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.573367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.573803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.574493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.574997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.575432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.600354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:41.601088 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:41.608958 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.608958 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.609139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.609795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.610248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.611161 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.798645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:41.800388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:41.807761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4085bdfb-220d-4a99-a06f-c1216db1ec62 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.246064 Sep 09 12:13:41.808336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 74/149] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:41 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:41.810032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c026c22f-be9b-4b4b-9e6b-e5f81fc76f6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.213473 Sep 09 12:13:41.810879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 76/150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:41 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:41.852347 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:41.852976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:41.858857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.859379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.859817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.860512 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.860969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.861390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.877214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:41.877822 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:41.884537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.885250 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.885776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.886445 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.886892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.887479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.092339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:42.100944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-db56f22b-d47d-49e2-ad99-be4495102fbf tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.252416 Sep 09 12:13:42.101803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 75/151] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:41 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:42.123821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:42.132751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:42.134637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:42.136090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-03099302-5811-40ba-9903-c9cc84f394ac tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.263232 Sep 09 12:13:42.136816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 77/152] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:41 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:42.832312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:42.833480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:42.833613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:42.834360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:42.840258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.840748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.841185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.841373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.841877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.842011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.842330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.842613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.842746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.843466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.843992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.844491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.051325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.060762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-56f2c176-0d9e-480e-9d5f-150a27a7c382 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.230807 Sep 09 12:13:43.061345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 78/153] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:42 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:43.066561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.074283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c12211e2-6260-42b8-ba59-9018048fa2d0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1321 microversion: 2.1 time: 0.247241 Sep 09 12:13:43.074870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 76/154] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:42 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:43.124556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:43.125603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:43.132520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.133715 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.133897 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.135029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.135956 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.137169 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.162080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:43.162682 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:43.169534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.170020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.170484 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.171338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.171785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.172373 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.381870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.396628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.416169 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b6c7be62-0f40-494f-8ead-b4966ab622cb tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1314 microversion: 2.1 time: 0.293633 Sep 09 12:13:43.418269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 79/155] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:43 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:43.424328 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.438744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:43.438744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c9ac2d98-0993-4c64-b2d9-64ee02bcc289 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.273710 Sep 09 12:13:43.438744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 77/156] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:43 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:43.873579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0cb5c6-89f6-4231-8311-7ddbe2693c70", "name": "network-vif-plugged", "status": "completed", "tag": "87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:43.886879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.887488 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.887921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.932546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] Creating event network-vif-plugged:87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d for instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 on hv-cinder-85221 Sep 09 12:13:43.941805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-01df7a30-40d8-469d-a570-0639979ccbed req-115fd958-4ef3-4f0b-ad99-ab444d7151ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071830 Sep 09 12:13:43.943814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 80/157] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:13:44.086874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:44.086874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.097913 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:44.098779 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.103007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.106134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.106679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.107948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.108065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.108405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.108832 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.109964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.110645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.113840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.113840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.115259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.122238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:44.346477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:44.357183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b1f11f62-dd48-4a20-b744-97e23c7c92f7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.277649 Sep 09 12:13:44.357781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 78/158] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:44 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:44.367344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:44.380182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8789c19a-b5b9-4cf7-a305-c807a94a9a77 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1515 microversion: 2.1 time: 0.286379 Sep 09 12:13:44.380878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 81/159] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:44 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:44.404113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:44.406408 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.412380 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.412869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.413304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.414002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.415056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.415480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.455567 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:44.455567 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.472100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.473859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.479232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.481096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.482778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.484827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.505983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'flavor' on Instance uuid aa2e2ea8-b146-4e6a-a71b-254e88b3275b {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:13:44.695202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:44.708982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9421711c-2444-4403-9ce4-98718dbca66a tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1501 microversion: 2.1 time: 0.259678 Sep 09 12:13:44.722310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-468d4069-d6b2-44d1-b823-41b3bdf6c195 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b/action" status: 200 len: 32 microversion: 2.1 time: 0.319064 Sep 09 12:13:44.723806 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 79/161] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:13:44 2022] POST /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:13:44.724071 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 82/161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:44 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:44.733501 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:44.734840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.742091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:44.743166 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:44.763711 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.765793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.767433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.773104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.773557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.774751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.774987 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.775381 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.775722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.776189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:44.791630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:44.792089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:45.109765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.124920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c0bdd6b8-c196-4cdc-8cd8-e66054029e5f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.387845 Sep 09 12:13:45.125928 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 83/162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:44 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:45.191453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.220288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.221734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.225120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c423260e-3db4-4de8-ae69-e97f53d57272 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.498938 Sep 09 12:13:45.235996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 80/163] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:44 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:45.383725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:45.383725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:45.394921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:45.395408 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:45.395964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:45.398194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:45.400588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:45.401047 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:45.615223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.637903 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c5785c08-bcd8-4b8a-a041-31c916762bd0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.260453 Sep 09 12:13:45.639202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 84/164] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:45 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:46.005925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "name": "network-vif-plugged", "status": "completed", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:46.015706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.016183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.016622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.028046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] Creating event network-vif-plugged:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:13:46.032812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-297a8e05-d1bd-45d9-957b-e6cfd2127544 req-f5d7d165-66ad-43cd-938d-9acbb0a09c08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030511 Sep 09 12:13:46.033389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 81/165] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:46.150707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:46.151460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.157960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.158435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.158865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.159565 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.160010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.160424 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.256755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:46.257450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.264265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.264754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.265193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.265883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.266333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.266756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.299574 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.308392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7ff8b962-c717-429c-851a-e34c09be0747 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.162628 Sep 09 12:13:46.309183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 85/166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:46 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:46.459623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d1c1159-5619-4e81-89ca-0725c2740690"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:46.462762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.466045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=99 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:46.472772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.473425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.474072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.474781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.475262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.475677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.507948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.518466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.520410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.521777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-351a09a0-1fa8-4d5e-86c7-00b6d1d48164 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.269281 Sep 09 12:13:46.524479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 82/167] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:46 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:46.666177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:46.666781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.672761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.673232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.673657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.674357 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.674804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.675244 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.825048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.832780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9b918184-f623-44e4-97f1-df9c93274227 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1368 microversion: 2.1 time: 0.171020 Sep 09 12:13:46.833447 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 83/168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:46 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:47.143388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d71d56a9-73d2-468c-b758-3da33ba39ec8 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "POST /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691015 Sep 09 12:13:47.143989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 86/169] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:13:46 2022] POST /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:47.333662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:47.334406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:47.341439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.341966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.342433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.343206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.343699 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.344138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.486645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:47.495307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-294358cf-b860-425a-a70d-e84c7fb4d28d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.165462 Sep 09 12:13:47.495817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 84/170] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:47 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:47.551901 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:47.552598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:47.560025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.560767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.561203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.561890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.562346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.562769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.703588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:47.712658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:47.714318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:47.715536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bfc3d978-9db5-4a26-a389-e49be4e9dcc0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.168311 Sep 09 12:13:47.716099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 87/171] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:47 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:47.857499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:47.858099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:47.864037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.864514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.864942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.865619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.866063 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.866479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.004391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:48.012400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5f6aa79a-06d0-455a-a00c-bc9051822a29 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1558 microversion: 2.1 time: 0.158691 Sep 09 12:13:48.012976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 85/172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:47 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:48.041952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:48.042444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:48.049418 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.049908 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.050346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.051080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.051541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.051966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.138494 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8da4e2d5-320c-4c02-8d52-4cf5d92159d4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100725 Sep 09 12:13:48.144811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 88/173] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:13:48 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:48.518012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:48.518635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:48.526011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.526504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.527229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.528114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.528821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.529404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.535897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:48.743121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:48.744250 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:48.755875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.764618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.765873 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:48.767031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:48.772851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:48.773751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:49.228100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:49.236114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ccfac64b-8535-4121-ba71-ae842cacddd6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.722345 Sep 09 12:13:49.236850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 86/174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:48 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:49.246648 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:49.258551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:49.260265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:49.261387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0c6656c4-8cd1-4737-9dcb-57dd0e9fb872 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1408 microversion: 2.20 time: 0.523337 Sep 09 12:13:49.261948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 89/175] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:48 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:13:49.950669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0cb5c6-89f6-4231-8311-7ddbe2693c70", "tag": "87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:49.960765 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:49.961426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:49.962065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:49.982002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] Creating event network-changed:87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d for instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 on hv-cinder-85221 Sep 09 12:13:49.990838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-49bb0705-19b1-4ad8-8dfc-f26f6cdc2bf9 req-a01514c4-4115-40ff-b36c-3bb0b03022c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044772 Sep 09 12:13:49.992854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 87/176] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:50.270545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:50.279005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:50.291475 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:50.292777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:50.303262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.305710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.306357 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.307758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.308234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.309022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.309723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.310411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.311113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.311983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.313466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.315053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.617795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:50.631841 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:50.635397 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:50.637459 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ac14b1f7-1c42-4ff8-94e7-a1d1c9cdb32f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1600 microversion: 2.20 time: 0.351573 Sep 09 12:13:50.639405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 88/177] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:50 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1600 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:50.661054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:50.666999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:50.667496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:50.669890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a72f1703-7d1a-4ebb-ac5d-4024b15af67a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.413702 Sep 09 12:13:50.671087 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 90/178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:50 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:50.682554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.683359 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.684623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.685767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:50.686386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:50.687383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:50.803768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4f14a3e6-440e-493b-9d83-0f6224a73549 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141569 Sep 09 12:13:50.807835 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 89/179] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Sep 9 12:13:50 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:13:51.693820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:51.694745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:51.702507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:51.703386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:51.703931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:51.704917 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:51.705503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:51.706017 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:51.969527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:51.979383 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-627f2b94-8c96-46b6-af26-c15210f1bf54 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.289579 Sep 09 12:13:51.980264 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 91/180] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:51 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:52.164122 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:52.173097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=98 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:52.175257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:52.175873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:52.176292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:52.189271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] Creating event network-changed:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:13:52.195006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-85f8acca-8554-4989-984e-9bce919b22c0 req-5d480eee-f51c-4d61-a3b1-53ac39eb2e78 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034775 Sep 09 12:13:52.196236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 90/181] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:53.004725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:53.006229 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:53.019419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:53.020939 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:53.022049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:53.023084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:53.024876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:53.025810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:53.177426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:53.187504 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3875619a-1793-4010-8503-54ab5b05a204 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.187157 Sep 09 12:13:53.189684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 92/182] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:52 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:54.212253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:54.213588 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:54.220155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:54.220633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:54.221061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:54.221744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:54.222211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:54.222630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:54.376083 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:54.385374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-72baa0b0-8113-4de6-b4a6-454b4105f69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.177284 Sep 09 12:13:54.385949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 91/183] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:54 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:55.409101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:55.409837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:55.418058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:55.418617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:55.419164 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:55.420095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:55.420687 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:55.421190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:55.574089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:55.588560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6bfaabfc-e121-476d-82eb-3e6556b2f9b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.183223 Sep 09 12:13:55.612217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 93/184] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:55 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:56.618891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:56.619663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:56.626429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:56.627072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:56.627522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:56.628285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:56.628900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:56.629459 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:56.770126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:56.779247 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3b146518-730d-410c-a1f3-ff178a68f6fd tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.165477 Sep 09 12:13:56.780080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 92/185] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:56 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:57.125027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:57.125577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:57.132375 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.133144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.134154 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.134804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.135285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.135708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.161193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1368676260", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "networks": [{"uuid": "8df526b8-9901-4be3-89a2-04790101930b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:57.163312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:13:57.250439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] validate_networks() for [('8df526b8-9901-4be3-89a2-04790101930b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:13:57.267858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e681b77c-4f8e-4b85-962d-059c732eb41e tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 204 len: 0 microversion: 2.1 time: 0.145717 Sep 09 12:13:57.269362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 94/186] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:13:57 2022] DELETE /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:13:57.279321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:57.280112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:57.287736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.288213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.288639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.290131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.290775 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.291251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.295950 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:57.490406 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:57.499934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-df1b10cc-3905-407c-9fb6-3c17b3782126 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1553 microversion: 2.1 time: 0.225539 Sep 09 12:13:57.500516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 95/187] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:57 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:57.674246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:57.674713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:57.675209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:57.675620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:57.676030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:57.685767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.686240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.686659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.687407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.687849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.688263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.704564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Getting quotas for project 80d60a0051c24f9b98bc252a0d0754cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:57.708371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Getting quotas for user 913344053b6244c584140807ab2149cb and project 80d60a0051c24f9b98bc252a0d0754cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:57.719509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:57.721757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:57.767377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5d2aef59-c0e0-420f-9062-7ec9823b49a6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611012 Sep 09 12:13:57.768022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 93/188] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:13:57.779368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f6a10a11-1006-417a-b09a-c5790f345749 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:57.779970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f6a10a11-1006-417a-b09a-c5790f345749 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:57.802830 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:57.803482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:57.810303 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.810792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.811256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.811945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:57.812604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:57.813217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:57.835270 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6a10a11-1006-417a-b09a-c5790f345749 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:57.842951 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f6a10a11-1006-417a-b09a-c5790f345749 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1214 microversion: 2.1 time: 0.067280 Sep 09 12:13:57.843823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 96/189] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:57 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:57.956934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:57.965317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-12e4d4b3-4059-41ca-a7bc-3f0ba55087b2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.166350 Sep 09 12:13:57.965880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 94/190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:57 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:58.522574 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:58.523907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:58.534743 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.535273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.535742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:58.536491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.536946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.537397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:58.672201 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:58.680275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94ac0e3b-4f11-41b0-b8a7-fbbc7e8a63a6 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1553 microversion: 2.1 time: 0.161507 Sep 09 12:13:58.681340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 97/191] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:58 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:58.866553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:58.867217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:58.873823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.874309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.874742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:58.875461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.875915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.876341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:58.936904 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:58.944466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2ae5efc2-8afd-4ac4-8fa0-24f99b1e7920 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1218 microversion: 2.1 time: 0.082015 Sep 09 12:13:58.945026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 95/192] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:58 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:58.988888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:58.989493 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:58.996203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.996683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.997115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:58.997792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:58.998241 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:58.998664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:59.128363 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:59.136313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-abfc1800-2ac9-4aa2-b43c-d3b5935a0351 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.151199 Sep 09 12:13:59.136875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 98/193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:58 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:59.703999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:59.704774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:59.710797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:59.711382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:59.711887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:59.713387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:59.713825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:59.714481 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:59.851272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:59.862192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9ffe63c2-23bc-4b7a-977a-bdfa104b8506 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1553 microversion: 2.1 time: 0.162027 Sep 09 12:13:59.863028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 96/194] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:59 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:59.967544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:59.968215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:59.976370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:59.976855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:59.977290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:59.978128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:59.978575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:59.979026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:00.041777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:00.049336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5a5c358e-a497-43fa-b551-a4e50a6c67ad tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1266 microversion: 2.1 time: 0.086394 Sep 09 12:14:00.049893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 99/195] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:59 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:00.159873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:00.160619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:00.166666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:00.167291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:00.167725 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:00.168404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:00.168850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:00.169362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:00.304286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:00.314108 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d6dfc974-8d9f-496a-b9d0-86f87103db7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.157876 Sep 09 12:14:00.314700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 97/196] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:00 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:00.886123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:00.886726 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:00.892886 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:00.893377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:00.893816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:00.894510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:00.894995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:00.895423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.026870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:01.035211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f0c99019-d7a4-41b4-87c9-e9983810aa07 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1553 microversion: 2.1 time: 0.152984 Sep 09 12:14:01.036269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 100/197] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:00 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:01.073477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:01.074429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:01.080315 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:01.080803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:01.081231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.081918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:01.082360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:01.082969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.153671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:01.161317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4d78c81a-9471-4dad-be11-1cfcbc17fcef tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1272 microversion: 2.1 time: 0.092067 Sep 09 12:14:01.161943 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 98/198] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:01 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:01.345144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:01.345974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:01.357688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:01.359197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:01.359822 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.360998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:01.362616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:01.363508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.390541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2577d93-3497-429f-8fdd-f2376217b20c", "name": "network-vif-deleted", "tag": "7e0b4dad-c154-432b-883f-3ce55a1b59c2"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:01.409702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:01.410194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:01.410635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:01.437923 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] Creating event network-vif-deleted:7e0b4dad-c154-432b-883f-3ce55a1b59c2 for instance b2577d93-3497-429f-8fdd-f2376217b20c on hv-cinder-85221 Sep 09 12:14:01.450716 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-30f56d4c-43e4-4574-bbe8-ba240f796241 req-75dab330-0da4-42e0-b15f-4d5b14995ac9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064793 Sep 09 12:14:01.453408 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 99/199] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:01.596244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:01.604555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f3ff8e5f-5927-497d-a052-6a1a9931ad78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.268916 Sep 09 12:14:01.605234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 101/200] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:01 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:02.061190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:02.061884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:02.069218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.069715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.070285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.070858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.071351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.071774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.103923 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.104319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.104744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.105191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lazy-loading 'fault' on Instance uuid b2577d93-3497-429f-8fdd-f2376217b20c {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:02.151570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab948442f326433c8e9f5f90314627aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433140f4c010464fa04a5622b26bc3ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:02.160359 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-77dc95ff-9650-487a-939f-55b8d42ccb42 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 200 len: 1350 microversion: 2.1 time: 0.104537 Sep 09 12:14:02.160939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 100/201] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:02 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:02.185791 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:02.186645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:02.193141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.193697 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.194200 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.194974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.195506 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.195991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.353468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:02.362726 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-baba3c55-e0f6-4e5a-989b-eaab1e263d6a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.181769 Sep 09 12:14:02.363614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 102/202] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:02 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:02.636622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:02.638259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:02.652640 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.654024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.654746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.655602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:02.656343 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:02.656855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:02.890108 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:02.904305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c9e96279-e6ec-4062-9245-b107f1461de8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.277124 Sep 09 12:14:02.904997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 101/203] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:02 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:03.184609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:03.185485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:03.192556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.193140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.193659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.194474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.195018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.195440 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.210776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] HTTP exception thrown: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Request method failure captured: Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c HTTP/1.1 Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3I1bj1IK6H_B4pwdXQegg1nFgKW9-1321kfu-F0e4iX9OyQBnEdakqNxVL9R6tYKFi_7Uu5zbeVZ6RdxhaX3JCO9QXWqnnkjjNS3isIBzpndN6wNmkyQXTxmP2AE2-nHKpX6HAQbtVmgv8E6Yr8NZfPAhmks-md4UpECvdBAKswoU Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:03.217219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: ab948442f326433c8e9f5f90314627aa Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.218640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b2577d93-3497-429f-8fdd-f2376217b20c'} Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:03.219498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.220585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.222287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Returning 404 to user: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:03.223159 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-315318ca-3055-4286-a413-7cfc93b77da4 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 404 len: 111 microversion: 2.1 time: 0.043495 Sep 09 12:14:03.223715 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 103/204] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:03 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:03.341764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:03.344333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:03.350133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.350619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.351116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.351803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.352259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.352854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.365618 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] HTTP exception thrown: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Request method failure captured: Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c/os-volume_attachments HTTP/1.1 Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3I1bj1IK6H_B4pwdXQegg1nFgKW9-1321kfu-F0e4iX9OyQBnEdakqNxVL9R6tYKFi_7Uu5zbeVZ6RdxhaX3JCO9QXWqnnkjjNS3isIBzpndN6wNmkyQXTxmP2AE2-nHKpX6HAQbtVmgv8E6Yr8NZfPAhmks-md4UpECvdBAKswoU Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:14:03.370321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: ab948442f326433c8e9f5f90314627aa Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.371587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'server_id': 'b2577d93-3497-429f-8fdd-f2376217b20c'} Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:03.372230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:03.373289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:03.374333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Returning 404 to user: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:03.374333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ca027532-3fc4-47fe-9e4a-03db1c02a6dc tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034622 Sep 09 12:14:03.374333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 102/205] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:14:03 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:03.387969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:03.389004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:03.395560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.396039 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.396471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.397155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.397598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.398171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.528091 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcca3083-19ff-459b-a3d0-8d58df0e458b", "tag": "8d5b6dc9-6f7a-45b6-be19-bad91111565b"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:03.539929 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.540637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.541133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.554626 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] Creating event network-changed:8d5b6dc9-6f7a-45b6-be19-bad91111565b for instance bcca3083-19ff-459b-a3d0-8d58df0e458b on hv-cinder-85221 Sep 09 12:14:03.562242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-67ce27d7-f545-4662-87b3-7d04857f1c7f req-fef1a0fe-5b8f-454b-b12f-494169bafd4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039916 Sep 09 12:14:03.563461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 103/206] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:14:03.577061 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:03.585706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b1ccc8fe-ddba-4b56-89ac-cb5ebcc108eb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.202688 Sep 09 12:14:03.586932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 104/207] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:03 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:03.928130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:03.928833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:03.936383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.936871 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.937412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:03.938212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:03.938671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:03.939126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.102973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:04.112756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f83ba997-4f40-46d3-93bd-ed4ca72023ba tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.188706 Sep 09 12:14:04.114130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 104/208] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:03 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:04.601203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:04.602358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:04.609459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.609706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:04.610305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.610786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:04.611097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.612093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.612706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.613277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.620915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.622882 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.624769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.626978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.631057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.631057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.649230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] HTTP exception thrown: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Request method failure captured: Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c HTTP/1.1 Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3I1bj1IK6H_B4pwdXQegg1nFgKW9-1321kfu-F0e4iX9OyQBnEdakqNxVL9R6tYKFi_7Uu5zbeVZ6RdxhaX3JCO9QXWqnnkjjNS3isIBzpndN6wNmkyQXTxmP2AE2-nHKpX6HAQbtVmgv8E6Yr8NZfPAhmks-md4UpECvdBAKswoU Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:04.651839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: ab948442f326433c8e9f5f90314627aa Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.653095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b2577d93-3497-429f-8fdd-f2376217b20c'} Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:04.653863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.655113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.657148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Returning 404 to user: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:04.658190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e1b515c8-5897-48dd-aef2-2a1ff8053264 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 404 len: 111 microversion: 2.1 time: 0.060867 Sep 09 12:14:04.658894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 105/209] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:14:04 2022] DELETE /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:04.667541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:04.668428 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] [instance: b2577d93-3497-429f-8fdd-f2376217b20c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:04.676289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.676976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.677554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.678391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:04.679036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:04.679616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:04.695576 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] HTTP exception thrown: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Request method failure captured: Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c HTTP/1.1 Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3I1bj1IK6H_B4pwdXQegg1nFgKW9-1321kfu-F0e4iX9OyQBnEdakqNxVL9R6tYKFi_7Uu5zbeVZ6RdxhaX3JCO9QXWqnnkjjNS3isIBzpndN6wNmkyQXTxmP2AE2-nHKpX6HAQbtVmgv8E6Yr8NZfPAhmks-md4UpECvdBAKswoU Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:04.697768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/433140f4c010464fa04a5622b26bc3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 433140f4c010464fa04a5622b26bc3ab Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1838410934 Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: ab948442f326433c8e9f5f90314627aa Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-DeleteServersTestJSON-1838410934-project Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.698971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b2577d93-3497-429f-8fdd-f2376217b20c'} Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:04.699728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. Sep 09 12:14:04.704206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:04.705347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] Returning 404 to user: Instance b2577d93-3497-429f-8fdd-f2376217b20c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:04.705347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-165e2836-f6aa-4d62-844b-b9dcccebc0b2 tempest-DeleteServersTestJSON-1838410934 tempest-DeleteServersTestJSON-1838410934-project] 10.222.0.49 "GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c" status: 404 len: 111 microversion: 2.1 time: 0.036134 Sep 09 12:14:04.705347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 106/210] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:04 2022] GET /compute/v2.1/servers/b2577d93-3497-429f-8fdd-f2376217b20c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:14:04.838515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:04.848820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e47652e-0a44-4de4-8eb9-01dcf2ff03df tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.243688 Sep 09 12:14:04.849882 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 105/211] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:04 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:05.137918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:05.138680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:05.146036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:05.146528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:05.146993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:05.147690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:05.148657 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:05.149520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:05.315768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:05.325354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fec6fd5b-29c8-4565-906e-c144940055ad tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.192341 Sep 09 12:14:05.326298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 107/212] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:05 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:05.876659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:05.877884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:05.885218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:05.886069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:05.886760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:05.887549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:05.888088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:05.888599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:06.064027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:06.072099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:06.075096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fa87883a-57f6-4460-9a4a-186d31bed0e8 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.204120 Sep 09 12:14:06.075924 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 106/213] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:05 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:06.351852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:06.353091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:06.363377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:06.364167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:06.364688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:06.365776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:06.366366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:06.366846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:06.597267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:06.609055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-edf65304-446d-40ea-a34d-b73d4f0973ab tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.263887 Sep 09 12:14:06.610404 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 108/214] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:06 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:07.099852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:07.100452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:07.108329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:07.109025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:07.109612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:07.110458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:07.111143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:07.111883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:07.275733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:07.285453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6040800e-f524-4262-80e2-902fff1b0645 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.189376 Sep 09 12:14:07.286284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 107/215] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:07 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:07.640502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:07.641761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:07.659269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:07.659852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:07.660298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:07.661307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:07.661810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:07.662237 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:07.840538 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:07.867265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:07.879020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c9e7a668-cc6e-4866-8058-6e65298c36e7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.245424 Sep 09 12:14:07.880217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 109/216] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:07 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:08.311503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:08.312224 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:08.326212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:08.328945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:08.331426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:08.332069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:08.333057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:08.339185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:08.340767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:08.341456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:08.793666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:08.802464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d851f285-7004-4e4d-8855-3d307a423238 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.497033 Sep 09 12:14:08.803615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 108/217] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:08 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:08.910190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:08.910801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:08.919518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:08.920714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:08.921153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:08.922013 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:08.922629 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:08.923227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:09.139803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:09.151032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-04fa1c4d-618d-4df3-a231-17be4e02661e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.243021 Sep 09 12:14:09.152197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 110/218] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:08 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:09.826676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:09.827310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:09.834009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:09.834502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:09.834974 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:09.835636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:09.837051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:09.837720 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:09.978397 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:09.989804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-44e250e5-3d29-4087-8661-9c5a757701b7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.164396 Sep 09 12:14:09.989804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 109/219] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:09 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:10.108829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-01d294e4-4b35-4aa3-adc9-4c49a78fb028 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Action: 'create', calling method: .version_select at 0x7f6bd103d4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-712847370", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-01d294e4-4b35-4aa3-adc9-4c49a78fb028 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 121 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:10.125141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-712847370", "metadata": {"Type": "work"}}} Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:14:10.126586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-712847370', 'metadata': {'Type': 'work'}}}} Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.127353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:14:10.128524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:14:10.129541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:14:10.129541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.129541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-01d294e4-4b35-4aa3-adc9-4c49a78fb028 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.129541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-01d294e4-4b35-4aa3-adc9-4c49a78fb028 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141651 Sep 09 12:14:10.129953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 111/220] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 9 12:14:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 12:14:10.138797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60076915-3597-401c-a9f0-108460e15eea tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Action: 'create', calling method: .version_select at 0x7f6bd0e241f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-183102810", "metadata": {"Type": "work"}}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60076915-3597-401c-a9f0-108460e15eea tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 119 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:14:10.143557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-183102810", "metadata": {"Type": "work"}}} Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: Sep 09 12:14:10.144932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-183102810', 'metadata': {'Type': 'work'}}}} Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi '0' Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.145653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:14:10.146827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:14:10.147921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:14:10.147921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.147921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60076915-3597-401c-a9f0-108460e15eea tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.147921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-60076915-3597-401c-a9f0-108460e15eea tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010857 Sep 09 12:14:10.147921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 110/221] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 9 12:14:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:14:10.154346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1924f97-7cca-409f-9378-331f6b4347c3 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Action: 'create', calling method: .version_select at 0x7f6bd0eda430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574653904", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1924f97-7cca-409f-9378-331f6b4347c3 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 118 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:10.158618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574653904", "metadata": {"Type": "work"}}} Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: Sep 09 12:14:10.160261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-574653904', 'metadata': {'Type': 'work'}}}} Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi '' Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.161215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:14:10.162720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:14:10.164083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:14:10.164083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.164083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1924f97-7cca-409f-9378-331f6b4347c3 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.164083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e1924f97-7cca-409f-9378-331f6b4347c3 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009418 Sep 09 12:14:10.165142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 112/222] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Sep 9 12:14:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:14:10.170001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b621f919-648b-4cde-9213-3cfa3cfd4607 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Calling method '.version_select at 0x7f6bd0ef68b0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:10.184165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:10.185049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:10.191300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:10.191986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:10.192662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:10.193463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:10.193997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:10.194486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:10.200875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-b621f919-648b-4cde-9213-3cfa3cfd4607 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] HTTP exception thrown: Volume tempest-invalid-1665540033 could not be found. Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b621f919-648b-4cde-9213-3cfa3cfd4607 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1665540033 HTTP/1.1 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:14:10.203236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Volume tempest-invalid-1665540033 could not be found. Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'tempest-invalid-1665540033'} Sep 09 12:14:10.204419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1665540033 could not be found. (HTTP 404) (Request-ID: req-05730af5-23c4-4b56-8f62-9d44d0f18944) Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.205217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:14:10.206336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1665540033 could not be found. Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:10.207464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1665540033 could not be found. Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1665540033 could not be found. Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b621f919-648b-4cde-9213-3cfa3cfd4607 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 404 to user: Volume tempest-invalid-1665540033 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b621f919-648b-4cde-9213-3cfa3cfd4607 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1665540033" status: 404 len: 99 microversion: 2.1 time: 0.038546 Sep 09 12:14:10.209813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 111/223] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 9 12:14:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1665540033 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 12:14:10.214292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-53bbdd60-6203-4ac7-8a2a-5975e40d140e tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003604 Sep 09 12:14:10.214797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 112/224] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Sep 9 12:14:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 12:14:10.223721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5dbbb510-4eef-477a-be59-9f4cb7be5926 tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003496 Sep 09 12:14:10.224309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 113/225] 10.222.0.49 () {58 vars in 1137 bytes} [Fri Sep 9 12:14:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 12:14:10.234376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dd1ff38d-8198-4542-a6b6-53ff23fe7e5d tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Calling method '.version_select at 0x7f6bd0e24940>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:10.266562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-dd1ff38d-8198-4542-a6b6-53ff23fe7e5d tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] HTTP exception thrown: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dd1ff38d-8198-4542-a6b6-53ff23fe7e5d tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/os-volumes/4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa HTTP/1.1 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:14:10.268778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa'} Sep 09 12:14:10.270050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. (HTTP 404) (Request-ID: req-0179b52a-2ced-4bf6-a4f0-59a74a70e0d9) Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.270834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:14:10.271881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:14:10.273095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dd1ff38d-8198-4542-a6b6-53ff23fe7e5d tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 404 to user: Volume 4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.274227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dd1ff38d-8198-4542-a6b6-53ff23fe7e5d tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa" status: 404 len: 109 microversion: 2.1 time: 0.040563 Sep 09 12:14:10.276051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 114/226] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:14:10 2022] DELETE /compute/v2.1/os-volumes/4e1acf5d-bca2-4b06-a7c7-b28a0f3fc2fa => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:10.281614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8a962ac-54ad-427a-865d-4104c4c01faf tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Calling method '.version_select at 0x7f6bd0e24700>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:10.311898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-a8a962ac-54ad-427a-865d-4104c4c01faf tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] HTTP exception thrown: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8a962ac-54ad-427a-865d-4104c4c01faf tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Request method failure captured: Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/os-volumes/4307009c-dd7c-437d-b040-a2d282d20822 HTTP/1.1 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy4RFAmMgVNnEAw4yIuk4d3JuVHN9mA40JLSTw6N6S9DOwkWuJnqC4dG4gjEzMTXNFLlftYVV-kSgN7QpKKy1RJGQ7yYxmlE-P3M0nuoxvOlEpFXTBRiwqKK3qoqxWQ77iRzAs3bv_URGRhUtIhAN3quSn0pF5VIZzMhgmpSVXJepmg Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:14:10.313833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aeb1faf788974a88a3333fe592e09320"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aeb1faf788974a88a3333fe592e09320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: aeb1faf788974a88a3333fe592e09320 Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesNegativeTest-861461255 Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: a25d9bd4e0ce4f388b166f30ba9569bb Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesNegativeTest-861461255-project Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '4307009c-dd7c-437d-b040-a2d282d20822'} Sep 09 12:14:10.315346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. (HTTP 404) (Request-ID: req-6305b1f3-813e-45aa-9dff-e6150d093c82) Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.316148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:14:10.317354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:14:10.318604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8a962ac-54ad-427a-865d-4104c4c01faf tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] Returning 404 to user: Volume 4307009c-dd7c-437d-b040-a2d282d20822 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a8a962ac-54ad-427a-865d-4104c4c01faf tempest-VolumesNegativeTest-861461255 tempest-VolumesNegativeTest-861461255-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4307009c-dd7c-437d-b040-a2d282d20822" status: 404 len: 109 microversion: 2.1 time: 0.037979 Sep 09 12:14:10.320252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 115/227] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Sep 9 12:14:10 2022] GET /compute/v2.1/os-volumes/4307009c-dd7c-437d-b040-a2d282d20822 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:10.375137 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:10.383694 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2413651e-c0e5-40dc-b2cb-41da26722454 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.206918 Sep 09 12:14:10.384776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 113/228] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:10 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:11.010969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:11.011583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:11.017670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:11.018151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:11.018585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:11.019295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:11.019747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:11.020165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:11.152290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:11.161804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6b03e21d-99bb-48e0-bebe-5b4d0cb4b18b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.155087 Sep 09 12:14:11.162516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 116/229] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:11 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:11.407483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:11.408145 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:11.416235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:11.416825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:11.417303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:11.417919 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:11.418366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:11.418893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:11.570929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:11.579962 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e166b3b-bfe5-4f6f-92a9-eb0b537df69b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.176398 Sep 09 12:14:11.580534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 114/230] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:11 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:11.786328 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca3083-19ff-459b-a3d0-8d58df0e458b", "name": "network-vif-plugged", "status": "completed", "tag": "8d5b6dc9-6f7a-45b6-be19-bad91111565b"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:11.798091 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:11.798549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:11.799250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:11.813349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] Creating event network-vif-plugged:8d5b6dc9-6f7a-45b6-be19-bad91111565b for instance bcca3083-19ff-459b-a3d0-8d58df0e458b on hv-cinder-85221 Sep 09 12:14:11.819065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-46e3f351-ac8a-4cee-a7cc-e4bc60c52896 req-0bfc5a90-2a5c-48b6-bce1-64158d714ad4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036142 Sep 09 12:14:11.819963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 117/231] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:12.186047 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:12.186649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:12.192551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.193029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.193457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.194131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.194578 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.195018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.329603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:12.337481 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a7cb9463-3f17-4b5b-b7c2-9a2f5f08ee26 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.155628 Sep 09 12:14:12.338044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 115/232] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:12 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:12.606321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:12.607005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:12.613954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.614440 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.614867 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.615583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.616031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.616476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.763073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:12.776367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-de788955-5593-48b2-bfdd-76976d988218 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.175538 Sep 09 12:14:12.782278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 118/233] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:12 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:13.360240 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:13.360847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:13.367244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:13.367723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:13.368245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:13.368926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:13.369381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:13.369798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:13.499591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:13.501832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:13.508332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d239845-1203-4a0f-bbaa-f0d23710315a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.151896 Sep 09 12:14:13.509067 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 116/234] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:13 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:13.800471 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:13.801589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:13.808532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:13.809033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:13.809474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:13.810445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:13.810911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:13.811342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:13.962628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:13.972015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-69ea9f6b-923e-45f8-9f0a-7a6e67e59f28 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.175263 Sep 09 12:14:13.973223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 119/235] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:13 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:14.530777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:14.531406 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:14.537805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:14.538283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:14.538713 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:14.539425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:14.540554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:14.541287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:14.676874 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:14.685589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f869bc8c-2fef-454b-a8fb-ee67ed36096b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.158601 Sep 09 12:14:14.686275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 117/236] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:14 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:14.995384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:14.995907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:15.001908 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.002391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.002831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:15.003562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.004017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.004438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:15.135989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:15.143643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-13caa507-ed67-4050-a79c-f1b946856fea tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.152361 Sep 09 12:14:15.144209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 120/237] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:14 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:15.708730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:15.709335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:15.715896 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.716380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.716817 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:15.717503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.717955 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.718380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:15.847602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:15.855645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f3d7df64-0851-4bf9-9994-c4f997759976 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1314 microversion: 2.1 time: 0.150731 Sep 09 12:14:15.856213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 118/238] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:15 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:16.167676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:16.168406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:16.174554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:16.175167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:16.175600 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:16.176287 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:16.176732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:16.177212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:16.316756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:16.326886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0bf5e453-1032-484d-b873-d85302577f01 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.163644 Sep 09 12:14:16.327473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 121/239] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:16 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:16.878044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:16.878604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:16.880657 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:16.886670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:16.887183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:16.887616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:16.888307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:16.888762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:16.889183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:17.027208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:17.034872 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6e958330-c446-4f9d-8595-34b667900cd0 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1498 microversion: 2.1 time: 0.160772 Sep 09 12:14:17.035638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 119/240] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:16 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:17.350577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:17.351245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:17.357602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:17.358084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:17.358525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:17.359318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:17.359770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:17.360196 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:17.492625 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:17.500869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-77ff573d-4483-4d3d-a3c0-1fb23390f58c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.154165 Sep 09 12:14:17.501433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 122/241] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:17 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:18.523672 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:18.524852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:18.531462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:18.531986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:18.532412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:18.533089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:18.533536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:18.533953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:18.662635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:18.670318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dbaf6f19-a9de-4824-ab66-8633b5253f81 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.150536 Sep 09 12:14:18.671187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 120/242] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:18 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:19.693827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:19.694371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:19.701062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:19.701538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:19.701997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:19.702677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:19.703160 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:19.703576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:19.838930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:19.846604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f7c68307-e8de-49d2-be04-8c574e66a145 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.156878 Sep 09 12:14:19.847199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 123/243] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:19 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:20.869392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:20.869995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:20.876692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:20.877181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:20.877826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:20.878521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:20.879000 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:20.879425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:21.017844 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:21.026496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-112850a6-790d-40db-a2ca-e88ab32e3e08 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.161250 Sep 09 12:14:21.027180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 121/244] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:20 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:22.050030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:22.050744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:22.057312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:22.057796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:22.058231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:22.058940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:22.059397 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:22.060073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:22.187649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:22.195174 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7d621c1a-81a0-4988-a19c-6a9ba4f9d288 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.148948 Sep 09 12:14:22.195838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 124/245] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:22 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:23.040435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:23.041064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:23.047512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.047988 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.048423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.049100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.049560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.049965 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.077174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:14:23.161655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b8a45544-173d-49ad-9e1d-e8dac85a6c39 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 204 len: 0 microversion: 2.1 time: 0.125306 Sep 09 12:14:23.162246 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 122/246] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:14:23 2022] DELETE /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:14:23.171076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:23.171685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:23.173675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:23.178714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.179238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.180348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.181232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.181597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.182021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.218840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:23.219650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:23.229217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.229806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.230435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.231589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:23.232052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:23.232826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:23.368693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:23.377992 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f91b59be-1ae0-46dc-9a79-ab57afc3d343 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1504 microversion: 2.1 time: 0.211307 Sep 09 12:14:23.379414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 125/247] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:23 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:23.414652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:23.422940 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4241cc1a-53e2-41f7-8bd5-dfd1d9e75dc8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.208868 Sep 09 12:14:23.423554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 123/248] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:23 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:24.402379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:24.403007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:24.408786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.409270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.409696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.410372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.410819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.411263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.448518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:24.448957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:24.472108 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.472108 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.483505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.484250 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.484726 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.485149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.635837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:24.645637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bb2acd59-9d0a-4c0c-8835-13bbe1851ffc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1504 microversion: 2.1 time: 0.247947 Sep 09 12:14:24.646736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 126/249] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:24 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:24.658826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:24.668046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3cc6b416-1c1f-4c5f-a4da-e97967bd4adf tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.224108 Sep 09 12:14:24.668889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 124/250] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:24 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:25.670696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:25.671528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:25.677495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.678052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.678567 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.679386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.680346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.680769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.691652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:25.692990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:25.705598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.706098 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.706543 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.707288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.707747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.708191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.893334 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:25.902748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-406a6109-a0a6-449a-972b-5356cbe297d1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1504 microversion: 2.1 time: 0.235863 Sep 09 12:14:25.903918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 127/251] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:25 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:25.930823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:25.938965 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-43d2c852-609d-45e1-8f9f-85c2e5961408 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.251196 Sep 09 12:14:25.939742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 125/252] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:25 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:26.926532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:26.928454 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:26.934333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.935242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.935763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.936544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.937097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.937595 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.963037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:26.963800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:26.971091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.971656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.972270 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.973122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.973650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.974425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:27.139424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:27.147551 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ddfe09af-b3b3-438b-87cb-6b5d32e7f804 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1504 microversion: 2.1 time: 0.224880 Sep 09 12:14:27.148136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 128/253] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:26 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:27.167305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:27.176216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-74171792-1e5a-46d9-b007-30d7080bca69 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.218412 Sep 09 12:14:27.177290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 126/254] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:26 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:28.177695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:28.178313 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:28.188888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.189909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.191168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.192482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.193306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.194147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.205190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:28.206977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:28.233495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.235442 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.236123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.237761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.240561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.241337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.474220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:28.479929 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:28.483706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-37a2c95a-b9e7-426c-a160-9356f6175b1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.283220 Sep 09 12:14:28.484640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 127/255] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:28 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:28.488382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-259782cc-b5f8-43b8-a267-577d7b906ae6 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1504 microversion: 2.1 time: 0.314968 Sep 09 12:14:28.488944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 129/256] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:28 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:29.509239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:29.509766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:29.510479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca3083-19ff-459b-a3d0-8d58df0e458b", "name": "network-vif-deleted", "tag": "8d5b6dc9-6f7a-45b6-be19-bad91111565b"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:29.520392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.520876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.520982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.521309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.521441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.524912 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.525454 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:29.529037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.529537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.529971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.535472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] Creating event network-vif-deleted:8d5b6dc9-6f7a-45b6-be19-bad91111565b for instance bcca3083-19ff-459b-a3d0-8d58df0e458b on hv-cinder-85221 Sep 09 12:14:29.542311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-12cf7fc2-e829-4efb-9208-d11796f649fd req-36e34e04-c7bc-4479-8fb6-bc98a2974c2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Sep 09 12:14:29.542926 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 130/257] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:14:29.548595 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:29.549290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:29.556503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.556991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.557538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.558241 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.558855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.559718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.638568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:29.648035 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0c04ce68-6761-4241-8828-c51540923c12 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1462 microversion: 2.1 time: 0.102945 Sep 09 12:14:29.649292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 131/258] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:29 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:29.708466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:29.717029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-678f37ea-bec1-4131-8b0e-11b627c1dedc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.213130 Sep 09 12:14:29.717604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 128/259] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:29 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:30.671072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:30.671689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:30.677790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:30.678278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:30.678711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.680018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:30.680608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:30.681033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.745169 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:30.746106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:30.746719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:30.753109 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:30.753586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:30.753727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-55e77cc1-42d3-4857-9a7b-1a63919e885f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1299 microversion: 2.1 time: 0.086569 Sep 09 12:14:30.754274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 132/260] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:30 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:30.754405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.775231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:30.775231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:30.775231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.908056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:30.916556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3c669c07-4719-4aad-a6ba-a264ee3634fc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.175068 Sep 09 12:14:30.917134 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 129/261] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:30 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:31.781322 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:31.781924 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:31.788025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.788504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.789046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:31.789954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.790432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.790849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:31.853461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:31.861306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-75f8aa8b-36e8-4fbb-b4c5-8eab4296e774 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1299 microversion: 2.1 time: 0.083817 Sep 09 12:14:31.861872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 133/262] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:31 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:31.940259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:31.940865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:31.949490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.950243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.950939 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:31.951616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.952066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.952679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:32.100177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:32.108142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7dea7f92-ded1-478c-aa6d-35a990f228b3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1521 microversion: 2.1 time: 0.171827 Sep 09 12:14:32.108708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 130/263] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:31 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:32.885535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:32.886117 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:32.893003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:32.893512 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:32.894002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:32.894863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:32.895402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:32.896108 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:32.929024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:32.930191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:32.930793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:32.931252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lazy-loading 'fault' on Instance uuid bcca3083-19ff-459b-a3d0-8d58df0e458b {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:32.974227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:32.982015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1163159f-e03c-4965-99f1-a7eb4985960f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 200 len: 1304 microversion: 2.1 time: 0.101819 Sep 09 12:14:32.982576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 134/264] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:32 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:33.131298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:33.131975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:33.139662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.140174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.140676 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.141434 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.141947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.142432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.456379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:33.459338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:33.470536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5daacf35-de9a-49db-a415-e7e39668da72 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1501 microversion: 2.1 time: 0.343023 Sep 09 12:14:33.471708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 131/265] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:33 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:33.495070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:33.496055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:33.503312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.503965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.504559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.505413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.506034 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.506607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.647260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:33.655126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1d9dd590-8478-4e4c-80e3-88998f43a414 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1516 microversion: 2.1 time: 0.164754 Sep 09 12:14:33.655609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 135/266] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:33 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:34.005841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:34.006510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: bcca3083-19ff-459b-a3d0-8d58df0e458b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:34.013354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.013837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.014269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.014982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.015438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.015861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.029149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] HTTP exception thrown: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Request method failure captured: Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b HTTP/1.1 Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy4DSROPkjakXZslkN8vyyrhpavaxzY4GF_ESO2OPnN9I4wmFnsFWoYcHA05Usoku8LP_6bGZyBGtuD-Q6yJr6R2utSmzaRWoHLY9aag8PYRkMe4SeyVwSWEk6GlvKVtj6GpfNfJYdOTdB1n3-Y7sZSJexKDTEsE_IvJWx7pgu8kO8g Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 80d60a0051c24f9b98bc252a0d0754cc Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesActionsTest-437162373 Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:14:34.030763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesActionsTest-437162373 Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 80d60a0051c24f9b98bc252a0d0754cc Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesActionsTest-437162373 Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesActionsTest-437162373-project Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 913344053b6244c584140807ab2149cb Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesActionsTest-437162373-project Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. Sep 09 12:14:34.032263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'bcca3083-19ff-459b-a3d0-8d58df0e458b'} Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:34.033106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. Sep 09 12:14:34.034502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:14:34.035767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Returning 404 to user: Instance bcca3083-19ff-459b-a3d0-8d58df0e458b could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:34.035767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-231215f6-1dcd-40ec-bec3-448704b07197 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b" status: 404 len: 111 microversion: 2.1 time: 0.030574 Sep 09 12:14:34.035767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 132/267] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:34 2022] GET /compute/v2.1/servers/bcca3083-19ff-459b-a3d0-8d58df0e458b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:34.135487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1745560701", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "networks": [{"uuid": "8df526b8-9901-4be3-89a2-04790101930b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:34.195905 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] validate_networks() for [('8df526b8-9901-4be3-89a2-04790101930b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:14:34.541833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:14:34.542335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:14:34.542840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:14:34.543483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:14:34.543930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:14:34.553108 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.553780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.554294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.555316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.555809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.556261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.573314 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Getting quotas for project 80d60a0051c24f9b98bc252a0d0754cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:14:34.577459 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Getting quotas for user 913344053b6244c584140807ab2149cb and project 80d60a0051c24f9b98bc252a0d0754cc. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:14:34.588893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:14:34.591210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:14:34.637887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e32ecd51-53bd-4212-a83f-255d3e98ebb5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506341 Sep 09 12:14:34.638534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 136/268] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:14:34.650390 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aad3e3d0-b95b-4526-9ddb-0039a9d441e5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:34.651027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aad3e3d0-b95b-4526-9ddb-0039a9d441e5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:34.705325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aad3e3d0-b95b-4526-9ddb-0039a9d441e5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:34.713752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aad3e3d0-b95b-4526-9ddb-0039a9d441e5 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1214 microversion: 2.1 time: 0.067856 Sep 09 12:14:34.714304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 133/269] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:34 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:35.736396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:35.737070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:35.743787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:35.744274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:35.744714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:35.745401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:35.745856 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:35.746283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:35.807159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:35.815009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-57988d42-bf68-4a59-ab85-65033219e70b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1218 microversion: 2.1 time: 0.082457 Sep 09 12:14:35.815518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 137/270] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:35 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:36.837559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:36.838173 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:36.844526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:36.845012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:36.845453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:36.846138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:36.846626 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:36.847158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:36.907425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:36.915319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-981835da-dfd1-4861-b0ec-9a3f377328f7 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1266 microversion: 2.1 time: 0.081677 Sep 09 12:14:36.915879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 134/271] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:36 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:37.939200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:37.939757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:37.946517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:37.947033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:37.947468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:37.948158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:37.948609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:37.949029 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:38.013230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:38.020902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c097fc5b-dc83-4be6-a399-32025dc9893e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1266 microversion: 2.1 time: 0.085706 Sep 09 12:14:38.021472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 138/272] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:37 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:39.044760 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:39.045376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:39.052102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:39.052589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:39.053029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:39.053721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:39.054331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:39.054767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:39.116544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:39.124409 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a96fb47e-ea14-4604-abae-88484b8baecd tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1266 microversion: 2.1 time: 0.083406 Sep 09 12:14:39.124970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 135/273] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:39 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:40.146842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:40.147712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:40.159340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.159837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.160268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.161072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.163480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.164491 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.325720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:40.328823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:40.329170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:40.338800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ee721291-84d6-4105-8e4d-28f12518ac23 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.195809 Sep 09 12:14:40.339531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 139/274] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:40 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:40.339923 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.340794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.341412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.342269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.343063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.344023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.372330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'flavor' on Instance uuid 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:40.491985 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d4e893ae-ab33-4cd8-ab83-a6c14bed5151 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/action" status: 200 len: 32 microversion: 2.1 time: 0.171959 Sep 09 12:14:40.492898 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 136/275] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:14:40 2022] POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 12:14:40.502241 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:40.503221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:40.509871 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.514213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.514839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.515986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.516610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.517200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.692115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:40.703602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9af3b320-ebc6-4b6b-b854-f6d7ba37c739 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.205370 Sep 09 12:14:40.704619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 140/276] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:40 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:40.977882 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab38a716-17c0-46d7-922c-e459b1dbf6fd", "tag": "6be3ae33-b174-4d54-8643-8fb2dc7fbbe4"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:40.988537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.989161 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.989693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.001545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] Creating event network-changed:6be3ae33-b174-4d54-8643-8fb2dc7fbbe4 for instance ab38a716-17c0-46d7-922c-e459b1dbf6fd on hv-cinder-85221 Sep 09 12:14:41.007981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ddd2a14f-c0d0-49f3-b90b-b1954aa987f1 req-31c0094d-a366-4923-afab-1bf11ede1dca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035717 Sep 09 12:14:41.008987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 137/277] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:41.363153 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:41.363759 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:41.370216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.370778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.371433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.372314 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.372762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.373179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.504932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.513082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0db4519d-47c1-41d1-8524-bb0f3ad111cc tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.153638 Sep 09 12:14:41.513650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 141/278] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:41 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:41.731252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:41.732115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:41.738294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.738868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.739405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.740178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.740720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.741217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.978073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.985852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c892811f-4d34-42c3-92b8-b97d3b4c6f75 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.259332 Sep 09 12:14:41.986521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 138/279] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:41 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:42.535869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:42.537120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:42.544506 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:42.544991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:42.545477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:42.546172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:42.546619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:42.548118 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:42.711553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:42.721626 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ed3545fd-22c4-41fa-8ddd-11478566d205 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.189454 Sep 09 12:14:42.726960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 142/280] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:42 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:43.011078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:43.011688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:43.018629 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.019153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.019591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.020300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.020840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.021313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.205850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.214323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-47aed03d-3486-44d2-b580-0d00f81a584c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.207771 Sep 09 12:14:43.214992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 139/281] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:43 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:43.745672 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:43.746277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:43.752178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.752679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.753115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.753795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.754240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.754657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.906093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.915486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-40bc4dfe-d761-49cb-af1e-797967b0550b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.173708 Sep 09 12:14:43.916314 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 143/282] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:43 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:44.242353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:44.243157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:44.258742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.259408 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.260088 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.262159 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.262728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.265592 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.557843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:44.569981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3dce3fcd-e240-414f-be67-53b31931e49e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.335234 Sep 09 12:14:44.587526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 140/283] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:44 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:44.935987 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:44.938075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:44.942672 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:44.943434 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:44.952001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.952677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.953252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.954289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.954993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.955580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.294280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.302577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-befca78f-e7d0-40a5-ac04-5200ce1e14ab tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.367446 Sep 09 12:14:45.303391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 144/284] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:44 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:45.593670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:45.594271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:45.599863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:45.602963 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:45.603639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:45.604228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.605074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:45.605671 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:45.606262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.769273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.779953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f515baf1-4387-44a5-86c1-8840688f44f6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.190088 Sep 09 12:14:45.790400 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 141/285] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:45 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:46.326424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:46.328376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:46.347268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.351423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.351950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.353206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.357274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.357815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.595090 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:46.608573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cb2ca06a-a9e8-42ff-8a54-53f6e5f0e2ed tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.285759 Sep 09 12:14:46.610751 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 145/286] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:46 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:46.807631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:46.808548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:46.822124 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.822642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.823318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.824041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.824501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.825119 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.078026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:47.087885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dd6c4e88-d572-466c-8db8-3aaae7d3ef18 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.285489 Sep 09 12:14:47.088891 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 142/287] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:46 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:47.636992 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:47.637783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:47.645030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:47.645873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:47.646578 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.648519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:47.649051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:47.650221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.812007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:47.820073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9262c19d-bfb8-4497-81c6-c85053d2f93a tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.189421 Sep 09 12:14:47.822105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 146/288] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:47 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:48.118018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:48.118633 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:48.125324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:48.126768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.127271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.127709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.128647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.129279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.129882 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.299232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:48.310861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5f70fb6f-2751-4dc2-bb6a-dfdb15148878 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.201194 Sep 09 12:14:48.312356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 143/289] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:48 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:48.843855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:48.845121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:48.852286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.852855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.853358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.854147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.854807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.855584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:49.065585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:49.069462 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:49.074879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-887a9aed-cf4e-4834-b1ca-e69bc697e650 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.236021 Sep 09 12:14:49.080006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 147/290] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:48 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:49.333946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:49.335520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:49.346684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:49.347235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:49.347681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:49.348395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:49.348851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:49.349277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:49.589467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:49.599391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9e657085-fdf7-4c98-ad45-1545ac89fd3a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.269388 Sep 09 12:14:49.602407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 144/291] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:49 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:50.108354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:50.109134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:50.120880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.121376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.121812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:50.123555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.123555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.124000 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:50.441158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:50.451963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-39385f62-7344-43f0-941e-cae38e17a0a1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.347356 Sep 09 12:14:50.470458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 148/292] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:50 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:50.627549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:50.629616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:50.644093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.647188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.649325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:50.650766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.652971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.654110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:50.973588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:50.988435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a200beb4-b425-413d-b582-685c4224b988 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.365206 Sep 09 12:14:50.989762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 145/293] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:50 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:51.477734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:51.478345 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:51.488069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:51.489505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:51.492344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:51.493323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:51.496175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:51.496792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:51.859336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:51.870746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9e0ca112-e8b6-4b57-b565-611cf09c5df1 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.396771 Sep 09 12:14:51.871272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 149/294] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:51 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:52.017086 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:52.017829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:52.030790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.032776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.034967 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:52.035981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.039480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.040191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:52.319176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:52.341691 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dddd5475-4f69-46ab-b6a7-7e8a24422507 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.331580 Sep 09 12:14:52.345542 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 146/295] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:52 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:52.897320 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:52.898073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:52.916415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.916915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.917375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:52.918071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.918756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.919207 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.124961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:53.133460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9685dff3-b6aa-49a3-b7a7-32a7178ae9be tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.239826 Sep 09 12:14:53.133965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 150/296] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:52 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:53.372871 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:53.373478 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:53.384328 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:53.385356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:53.386025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.387168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:53.388351 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:53.389217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.613970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:53.624519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1fdbfecd-01c3-48e5-b9c5-dfd6d68d9cb6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.255524 Sep 09 12:14:53.631128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 147/297] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:53 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:53.745390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab38a716-17c0-46d7-922c-e459b1dbf6fd", "name": "network-vif-plugged", "status": "completed", "tag": "6be3ae33-b174-4d54-8643-8fb2dc7fbbe4"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:53.758308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:53.760516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:53.761636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:53.762377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.778529 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] Creating event network-vif-plugged:6be3ae33-b174-4d54-8643-8fb2dc7fbbe4 for instance ab38a716-17c0-46d7-922c-e459b1dbf6fd on hv-cinder-85221 Sep 09 12:14:53.784514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-376847d3-4d53-4ca7-9471-ea687c0f8fd0 req-ba16a031-ecaf-4f0e-b7d3-b162c14e6eb0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Sep 09 12:14:53.787825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 151/298] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:54.160431 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:54.161418 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:54.178655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.179641 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.180260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.181169 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.181848 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.182492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.426878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:54.429829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:54.464854 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a975fae1-f624-4745-ade8-6e3bb161c850 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.310601 Sep 09 12:14:54.465413 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 148/299] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:54 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:54.659223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:54.660946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:54.670100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.671179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.672249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.673777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.675262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.676327 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.715889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fa0d9c10-107b-4ab7-b976-db080fa4cb07 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Action: 'create', calling method: .version_select at 0x7f6bd0e244c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2045061559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGkwkaCWZ/MjeHCsPGJXx6wjIJ6PUw5KvvhGoLVhUBOGAtCllZjhrLterpbNs5eA8yQTJL0rsx5YxyRGho8lKLI7IBi/1FMn3kxzDVzeZ5rqbGxdeYh7Srrq0O9GWZKyg=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:54.743274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-fa0d9c10-107b-4ab7-b976-db080fa4cb07 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Getting quotas for project 6b0570ae08fc40ccb3dd942591098d34. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:14:54.748219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-fa0d9c10-107b-4ab7-b976-db080fa4cb07 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Getting quotas for user 9750f671d674447f9fbf36d382573c37 and project 6b0570ae08fc40ccb3dd942591098d34. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:14:54.791056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fa0d9c10-107b-4ab7-b976-db080fa4cb07 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.354123 Sep 09 12:14:54.791673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 152/300] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:14:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:54.884219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:54.893631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2461570a-fc9c-4259-8096-ebf9ba64bf26 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.241193 Sep 09 12:14:54.894665 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 149/301] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:54 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:55.495975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:55.496773 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:55.504623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.505146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.505585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:55.506535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.507128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.507893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:55.713730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:55.721783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-26fa8df8-babb-47e8-8f8c-edd42af6808e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.230515 Sep 09 12:14:55.722718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 153/302] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:55 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:55.918346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:55.919753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:55.928124 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.928857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.929924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:55.931368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.932083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.932660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:56.141365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:56.150839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-587ae102-6932-45c6-b569-afcdc869fbde tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.236952 Sep 09 12:14:56.162936 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 150/303] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:55 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:56.747933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:56.748511 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:56.755988 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:56.756612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:56.757154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:56.757896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:56.758514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:56.758967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:57.041527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:57.049385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9652a8bb-b8b6-44dd-8bbe-4ba566cd586b tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.306261 Sep 09 12:14:57.049949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 154/304] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:56 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:57.176332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:57.176941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:57.183043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:57.183523 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:57.184216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:57.184895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:57.185348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:57.185778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:57.327217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:57.334959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8ac4be9a-3454-45cd-a3cf-803cb3d4aa51 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.162519 Sep 09 12:14:57.335634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 151/305] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:57 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:58.074533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:58.075821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:58.082053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.082643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.083326 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.084097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.085445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.085875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.232361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:58.246304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a2c3d8a5-30e8-4671-a0f9-cbd6b2816b11 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1314 microversion: 2.1 time: 0.172504 Sep 09 12:14:58.247001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 155/306] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:58 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:58.359809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:58.360332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:58.367581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.367964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.368210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.368941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.369401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.371885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.532446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:58.542199 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-178e808f-8908-4e25-8919-ee039bccc92f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.186731 Sep 09 12:14:58.543571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 152/307] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:58 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:59.269653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:59.271114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:59.278926 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.279415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.279849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.280540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.280991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.281418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.442018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:59.457096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-db06745b-218d-43ae-b607-11cd4597d341 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1499 microversion: 2.1 time: 0.191170 Sep 09 12:14:59.457661 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 156/308] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:59 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1499 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:59.567528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:59.569550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:59.576506 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.576988 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.577457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.578150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.578601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.579052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.739686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:59.752035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2a022856-6b81-4d46-8d68-bcabfddd5c78 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.188323 Sep 09 12:14:59.753022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 153/309] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:59 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:00.113836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:00.114354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:00.121975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.122585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.122884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.123647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.124093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.124509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.152816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:15:00.247377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6dd29acb-b89f-4c7b-8d84-31ed1527081e tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 204 len: 0 microversion: 2.1 time: 0.137240 Sep 09 12:15:00.251028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 157/310] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:15:00 2022] DELETE /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:15:00.258560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:00.259300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:00.266309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.266932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.267520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.268334 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.268796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.269221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.419369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:00.429981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-378073b7-f31d-4eca-9394-f4198e8378bb tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1505 microversion: 2.1 time: 0.176465 Sep 09 12:15:00.430566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 154/311] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:00 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:00.779469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:00.780300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:00.787127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.787127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.788103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.788952 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.789413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.789843 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.957221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:00.969399 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b83f1546-e0ab-4c98-9b24-31fafc1236a1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.194814 Sep 09 12:15:00.969973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 158/312] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:00 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:01.455092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:01.455700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:01.463895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:01.465003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:01.465436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:01.466649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:01.468069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:01.468751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:01.624719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:01.634182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dd2a5ec7-8dc2-4955-9fd6-55a4bca8a4b4 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1505 microversion: 2.1 time: 0.183416 Sep 09 12:15:01.634878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 155/313] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:01 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:01.995748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:01.996484 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:02.004272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.004787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.005235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.006536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.007033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.007571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.172182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:02.195812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ede7b35c-db79-4324-b865-5ee6c7c00268 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.204172 Sep 09 12:15:02.196808 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 159/314] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:01 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:02.661857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:02.663790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:02.672409 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.673128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.673750 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.674655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.675337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.675990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.793991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:02.795018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:02.804996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.805820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.806450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.807632 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.808505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.809399 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.840956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d6b9f910-8850-43f6-958c-2be5c25c4216 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/ips" status: 200 len: 150 microversion: 2.1 time: 0.068111 Sep 09 12:15:02.841942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 160/315] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:15:02 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:02.861026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:02.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-55b1e14d-6057-4caa-a0c5-13198fb1bfc2 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1505 microversion: 2.1 time: 0.215079 Sep 09 12:15:02.875163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 156/316] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:02 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:03.097156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab38a716-17c0-46d7-922c-e459b1dbf6fd", "name": "network-vif-deleted", "tag": "6be3ae33-b174-4d54-8643-8fb2dc7fbbe4"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:03.108945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.109480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.109915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.126503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] Creating event network-vif-deleted:6be3ae33-b174-4d54-8643-8fb2dc7fbbe4 for instance ab38a716-17c0-46d7-922c-e459b1dbf6fd on hv-cinder-85221 Sep 09 12:15:03.132878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-45431a45-426c-4d09-993d-79521d0ee449 req-b2efadc0-3989-4030-979c-51c0910d631d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039968 Sep 09 12:15:03.134537 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 161/317] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:03.225425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:03.226354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:03.241368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.242710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.243392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.244385 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.245008 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.245700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.419020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:03.427575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e25d6e8-9420-4957-aca9-aef296d88618 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.206899 Sep 09 12:15:03.428669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 157/318] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:03 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:03.898469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:03.899303 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:03.915210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.915210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.915210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.915210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.915839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.915839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.952161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:03.952969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:03.953571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.954182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lazy-loading 'fault' on Instance uuid ab38a716-17c0-46d7-922c-e459b1dbf6fd {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:15:04.027636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '913344053b6244c584140807ab2149cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d60a0051c24f9b98bc252a0d0754cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:04.036336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-99d5d9f9-0c70-4c79-9aaa-602671b9064f tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 200 len: 1304 microversion: 2.1 time: 0.141999 Sep 09 12:15:04.046939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 162/319] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:03 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:04.396736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6677887c-7448-4ba7-abc1-77af6f4b3482"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:04.400099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:04.406776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.407292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.407730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.408426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.408881 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.409304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.451472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:04.452176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:04.458507 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.459661 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.460387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.461323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.462100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.462607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.605921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:04.614372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0af2dbc1-723a-4615-911f-c03289dd1654 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.166652 Sep 09 12:15:04.614988 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 163/320] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:04 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:04.673448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a1202e1f-3182-4224-8848-3f7ff30052f3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280926 Sep 09 12:15:04.674063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 158/321] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:15:04 2022] POST /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:05.059881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:05.065515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:05.065515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] [instance: ab38a716-17c0-46d7-922c-e459b1dbf6fd] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:05.072235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.072660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.073100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.073829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.074330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.074708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.088914 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] HTTP exception thrown: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Request method failure captured: Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd HTTP/1.1 Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy4DSROPkjakXZslkN8vyyrhpavaxzY4GF_ESO2OPnN9I4wmFnsFWoYcHA05Usoku8LP_6bGZyBGtuD-Q6yJr6R2utSmzaRWoHLY9aag8PYRkMe4SeyVwSWEk6GlvKVtj6GpfNfJYdOTdB1n3-Y7sZSJexKDTEsE_IvJWx7pgu8kO8g Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 80d60a0051c24f9b98bc252a0d0754cc Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesActionsTest-437162373 Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:15:05.091286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80d60a0051c24f9b98bc252a0d0754cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesActionsTest-437162373 Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 80d60a0051c24f9b98bc252a0d0754cc Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesActionsTest-437162373 Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesActionsTest-437162373-project Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 913344053b6244c584140807ab2149cb Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesActionsTest-437162373-project Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. Sep 09 12:15:05.092733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'ab38a716-17c0-46d7-922c-e459b1dbf6fd'} Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:15:05.093458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. Sep 09 12:15:05.094637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:05.095717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] Returning 404 to user: Instance ab38a716-17c0-46d7-922c-e459b1dbf6fd could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:15:05.095717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-53454ded-1297-47e5-bdc9-28413278bf22 tempest-VolumesActionsTest-437162373 tempest-VolumesActionsTest-437162373-project] 10.222.0.49 "GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd" status: 404 len: 111 microversion: 2.1 time: 0.034148 Sep 09 12:15:05.095717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 164/322] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:05 2022] GET /compute/v2.1/servers/ab38a716-17c0-46d7-922c-e459b1dbf6fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:15:05.641444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:05.641444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:05.646632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.647415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.648503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.650221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.650221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.650221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.838620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:05.847403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-010cae26-a48a-44fa-a8fe-2c6d5831964d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.213428 Sep 09 12:15:05.848112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 159/323] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:05 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:06.872563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:06.873636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:06.879433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:06.879721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:06.880316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:06.881883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:06.882455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:06.883116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:07.018125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:07.021762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:07.026969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4940341c-dd94-4563-990a-04335c2963a0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.158262 Sep 09 12:15:07.027533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 165/324] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:06 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:08.057279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:08.058018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:08.066961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:08.067454 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:08.067894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:08.069293 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:08.069756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:08.070182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:08.284826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:08.293679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-02d12e8a-a19c-4fa9-9a44-8df193ca0860 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.241812 Sep 09 12:15:08.294263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 160/325] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:08 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:09.319766 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:09.320306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:09.327416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:09.328071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:09.328534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:09.329206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:09.329659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:09.330081 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:09.473668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:09.481904 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-452df308-dd9a-4d45-a10e-4a033c9f46d8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.166904 Sep 09 12:15:09.482479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 166/326] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:09 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:10.507080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:10.507857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:10.514243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.514887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.515177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:10.515860 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.516307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.516727 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:10.532034 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:10.533286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:10.540718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.541279 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.541789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:10.542650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.543523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.544026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:10.572182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-17849456-7a81-4407-aa23-88cb619b424d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/ips" status: 200 len: 151 microversion: 2.20 time: 0.044036 Sep 09 12:15:10.572707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 167/327] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Sep 9 12:15:10 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:15:10.679344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:10.690412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3477922d-ed46-44b7-91c8-f9dbdd2f4881 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.188823 Sep 09 12:15:10.691026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 161/328] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:10 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:11.713771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:11.714468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:11.720678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:11.721168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:11.721608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:11.722309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:11.722968 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:11.723402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:11.862269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:11.871331 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c0aca5a7-a220-46b6-bbb9-b2c4be42f70b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.161415 Sep 09 12:15:11.871921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 168/329] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:11 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:12.552876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2176c919-00a2-454e-846c-95ff74d8bd3a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: .version_select at 0x7f6bd0d44700>, body: {"keypair": {"name": "tempest-keypair-582071428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAeDV36t4YwHV4khhzfQGQsqxMR+pjve3UPh7hP7q3fIBEskamLpHpt5Qp0PwbVRgpzwQG2scu4hYDfgFKusvixFgF1AY/7Rm7N8NtTQWHgHNMHxBLZ0f4fPPXsiY1hkw=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:12.569686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-2176c919-00a2-454e-846c-95ff74d8bd3a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:12.574106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-2176c919-00a2-454e-846c-95ff74d8bd3a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:12.596616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2176c919-00a2-454e-846c-95ff74d8bd3a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048275 Sep 09 12:15:12.597215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 162/330] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:15:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:12.894663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:12.895408 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:12.901836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:12.902428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:12.902986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:12.903690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:12.904149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:12.904572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:13.016790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:13.017469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:13.024899 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:13.025511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:13.026074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:13.026878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:13.027494 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:13.028142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:13.059244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lazy-loading 'flavor' on Instance uuid 578576a5-5165-4c3b-b095-1ca6461b2610 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:15:13.108918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:13.166467 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:13.174885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1f3cc8c5-ac69-4240-bde9-1f49f33c848d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.284061 Sep 09 12:15:13.175492 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 169/331] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:12 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:14.020292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2049028843", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2"}], "security_groups": [{"name": "tempest-securitygroup--339956670"}], "key_name": "tempest-keypair-582071428", "user_data": "}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:14.029276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f6cab751-783d-4a68-b2e9-b87a1f261704 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/action" status: 202 len: 0 microversion: 2.20 time: 1.018004 Sep 09 12:15:14.030006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 163/332] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 9 12:15:13 2022] POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/action => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:15:14.041668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:14.043395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:14.052835 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.053606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.054237 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.055216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.055914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.056344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.214394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] validate_networks() for [('8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:15:14.292993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:14.301706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:14.304303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:14.305745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb97c0be-3c4a-4dcf-9642-b36339675911 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.270843 Sep 09 12:15:14.306526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 164/333] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:14 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:14.311369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:14.312037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:14.318467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.319451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.319961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.320991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.321796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.322438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.766256 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:14.775474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c449bc6e-b841-468b-b03f-b5b6102da425 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.467716 Sep 09 12:15:14.776053 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 165/334] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:14 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:14.895157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:15:14.895583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:15:14.896120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:15:14.896606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:15:14.897019 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:15:14.906554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.907073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.907514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.908252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.909044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.909486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.925778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:14.930442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:14.941572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:15:14.944592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:15:14.992089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cc38dbcb-5dba-4c3f-a3bf-51d672e48416 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.976529 Sep 09 12:15:14.992741 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 170/335] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:15:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:15:15.003858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ebba50bf-db76-45f3-961a-21c14ba2a36c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:15.004477 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ebba50bf-db76-45f3-961a-21c14ba2a36c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:15.058075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebba50bf-db76-45f3-961a-21c14ba2a36c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.065746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ebba50bf-db76-45f3-961a-21c14ba2a36c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1241 microversion: 2.1 time: 0.065679 Sep 09 12:15:15.066319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 166/336] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:14 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:15.336086 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:15.336698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:15.343734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:15.344223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:15.344655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:15.345354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:15.345831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:15.346261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:15.479380 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.487601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.489057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.490279 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7497bd6d-d452-44fc-80bd-3069b4a70751 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.159021 Sep 09 12:15:15.494917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 171/337] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:15 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:15.798114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:15.798839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:15.806984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:15.807463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:15.807892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:15.808830 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:15.809281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:15.809702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:15.937101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.944804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0243aeba-467e-404a-9910-5342cd6f042f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.150510 Sep 09 12:15:15.945429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 167/338] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:15 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:16.087948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:16.088568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:16.095292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.095779 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.096544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.096900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.097356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.097784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.161760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.171966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d3a395d4-5181-47e3-9596-c97bd8446145 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1245 microversion: 2.1 time: 0.087673 Sep 09 12:15:16.172791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 172/339] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:16 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:16.517252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:16.517252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:16.523021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.523501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.523934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.524620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.525071 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.525493 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.660819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.668973 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.670422 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.672007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4068163a-bd45-4479-821c-59d9844cbd2c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.159984 Sep 09 12:15:16.672563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 168/340] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:16 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:16.967608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:16.968145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:16.974085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.974572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.975054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.975830 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.976202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.976627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.106862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.114466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-95e08077-5445-4a75-9c10-40881023d998 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.150850 Sep 09 12:15:17.115562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 173/341] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:16 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:17.196920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:17.197527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:17.203811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.204286 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.204717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.205395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.205840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.206260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.267888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.275916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-33f5fb12-aaf4-4ef6-9fb3-1c4b58f36702 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1245 microversion: 2.1 time: 0.083778 Sep 09 12:15:17.276483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 169/342] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:17 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:17.697794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:17.698410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:17.704480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.704972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.705410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.706102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.706559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.707014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.858482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.868739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.870327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.871579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2d8515bb-538c-439b-a2dd-3d4f3aebd4b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.177781 Sep 09 12:15:17.872325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 174/343] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:17 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:18.139745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:18.140134 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:18.144237 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:18.149183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.150113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.150626 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.151613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.152147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.153038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.297093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:18.299321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:18.299926 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:18.305555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3e6f6667-9923-4233-9935-e3d9ac3fe66f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.170542 Sep 09 12:15:18.305935 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.319574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.320346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 170/344] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:18 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:18.320445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.320445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.320445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.320445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.376699 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:18.385155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a04e8ab6-fdf2-43d1-a26d-eca6659e54c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1293 microversion: 2.1 time: 0.089628 Sep 09 12:15:18.385721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 175/345] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:18 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:18.897515 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:18.898352 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:18.904739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.905482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.906073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.906981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.907636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.908059 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.072009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:19.082292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:19.084057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:19.085363 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7ee1b4b6-ea61-4ddc-ad1e-3bfe844c80b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.192016 Sep 09 12:15:19.086061 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 171/346] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:18 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:19.332191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:19.333044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:19.339648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.340136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.340577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.341353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.341809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.342448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.410405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:19.410992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:19.421119 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.421611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.422050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.422762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.423230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.423658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.501327 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:19.512079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7634ac42-0f16-4d9c-a7bc-d7fc07cc2a90 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1301 microversion: 2.1 time: 0.105819 Sep 09 12:15:19.513223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 172/347] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:19 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:19.540001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:19.547887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b86a7b1d-350f-45c1-8eaa-a02bc263c759 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.219807 Sep 09 12:15:19.549609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 176/348] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:19 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:20.115301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:20.116056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.133899 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.134564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.135071 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.136202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.138295 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.140434 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.342260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.362528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.364700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.367990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6d743d25-bdba-46f5-8915-c7bcf33f7d36 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.257629 Sep 09 12:15:20.388266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 173/349] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:20 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:20.539289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:20.542220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.557318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.557813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.558255 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.559278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.559739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.560164 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.576787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:20.577412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.587751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.588243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.589003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.589720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.590176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.590602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.656273 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.681300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-de24d18f-24b7-48d4-b562-78ef777b853a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1299 microversion: 2.1 time: 0.142777 Sep 09 12:15:20.681940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 177/350] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:20 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:20.781931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.790266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-959b4d90-7819-44d3-a313-f52d1c1028f8 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1502 microversion: 2.1 time: 0.219250 Sep 09 12:15:20.791165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 174/351] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:20 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:20.820712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5722347a-ae43-41dd-a8bf-703b6f881316"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:20.823564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.833950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.835311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.836656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.837606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.838283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.839240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.870143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] HTTP exception thrown: Cannot 'attach_volume' instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 while it is in vm_state rescued Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Request method failure captured: Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/os-volume_attachments HTTP/1.1 Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 74 Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3CnrLCJ6oOehmzbF8gFtuup_oiv1UdC2bs9O30p4ZpA3TgQ5RMWadleaQS7PixloHYcu9pAiQlgaLuEi7VfXswozZyukkpxsO6tDqfkjsYGQJX88xBaRJ89J0hdXS1j2ByLNqpn3Rd7k1KE3KSDaq-eaeUfDpqXzt7DefLkWXADPw Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:15:20.872419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 31411178e5c342b7bb14a21dec62f540 Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {"volumeAttachment": {"volumeId": "5722347a-ae43-41dd-a8bf-703b6f881316"}} Sep 09 12:15:20.873635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Cannot 'attach_volume' instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 while it is in vm_state rescued Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'server_id': '42bf6d84-bbe7-47cd-90f4-21b3a6eef971', 'body': {'volumeAttachment': {'volumeId': '5722347a-ae43-41dd-a8bf-703b6f881316'}}} Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:15:20.874339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 while it is in vm_state rescued Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:15:20.875480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:15:20.877421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:15:20.877421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:15:20.877421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 while it is in vm_state rescued Sep 09 12:15:20.877421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:15:20.878675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Returning 409 to user: Cannot 'attach_volume' instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 while it is in vm_state rescued {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:15:20.879769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-720fcfe5-533e-4eb7-9d20-80bd2a450219 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064651 Sep 09 12:15:20.880604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 178/352] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:15:20 2022] POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 12:15:20.892000 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:20.898116 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.904514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.905203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.905764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.906551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.907119 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.907617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.980407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d05c2472-20a4-4020-9086-d3f011295932 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/action" status: 202 len: 0 microversion: 2.1 time: 0.092175 Sep 09 12:15:20.983144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 175/353] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:15:20 2022] POST /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:15:20.994694 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:20.995355 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:21.002159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.002660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.003142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.003855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.004306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.004732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.232790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.247455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-31068c72-99c2-41c5-8938-9d98a74c8edb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1510 microversion: 2.1 time: 0.258126 Sep 09 12:15:21.248704 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 179/354] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:20 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:21.397910 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:21.398822 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:21.411139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.411938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.413527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.414235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.414701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.415261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.610084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.619221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.620962 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.622325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c9e40148-ac34-478b-8f94-f2d6e403dd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.229567 Sep 09 12:15:21.638963 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 176/355] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:21 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:21.710937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:21.712288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:21.720555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.721062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.721711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.722476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.722989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.723590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.887115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.916146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-010a350a-52ac-4f32-adf3-f5774d1ffc78 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.200964 Sep 09 12:15:21.925739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 180/356] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:21 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:22.272585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:22.273843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:22.290953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.293100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.295999 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:22.296910 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.297509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.298085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:22.511279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:22.523941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c48ce1ea-5e2b-486f-b9e6-0a3e8ea8604c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1510 microversion: 2.1 time: 0.253308 Sep 09 12:15:22.524596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 177/357] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:22 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:22.650937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:22.651289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:22.668636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.669601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.669601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:22.670273 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.670725 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.671195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:22.907352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:22.942088 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:22.948303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:22.975613 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:22.982127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.986957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:22.989188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-29678250-5ec9-45e8-ba10-ff235713fd9a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.343805 Sep 09 12:15:22.990096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.992486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 181/358] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:22 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:23.015800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.024168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:23.026117 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:23.028555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.033596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49cbcd0c-7039-4918-a52c-75870c5b8000", "tag": "9b077fb5-abd1-479a-9b92-689ddd0746ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:23.070055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:23.071011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:23.072606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.109821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] Creating event network-changed:9b077fb5-abd1-479a-9b92-689ddd0746ee for instance 49cbcd0c-7039-4918-a52c-75870c5b8000 on hv-cinder-85221 Sep 09 12:15:23.117981 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b89dfb2b-c343-44ab-83a5-dd2bc51f0184 req-7c59a2d8-b09a-442e-83be-865926df0b54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094180 Sep 09 12:15:23.118589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 182/359] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:23.268820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:23.278513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ad9b938b-152d-4d77-9b65-f396a1701805 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.350816 Sep 09 12:15:23.279618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 178/360] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:22 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:23.553176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:23.555378 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:23.581939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:23.582930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:23.583632 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.585083 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:23.589256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:23.590128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.798344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:23.810292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9e57ac6b-6afb-4540-8333-333356da0ae6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1510 microversion: 2.1 time: 0.263586 Sep 09 12:15:23.823581 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 183/361] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:23 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:24.025051 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:24.026084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:24.043661 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.044282 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.045577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.047873 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.048349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.048944 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.302338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:24.303402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:24.305066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.307909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:24.313074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:24.317026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.320282 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.320959 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.322611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.326829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.327350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.340813 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.342693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.344448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f21a385e-5022-49b5-8e0a-acf488b5966e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.325810 Sep 09 12:15:24.345246 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 179/362] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:24 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:24.402232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:24.614685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.624528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2fe5cee6-0a1d-4718-84fa-c580a559faa4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.326008 Sep 09 12:15:24.625673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 184/363] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:24 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:24.839177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:24.840299 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:24.855168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.857120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.857922 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.860320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.860812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.861222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.045142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.057052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6c1d7db7-2faf-4f4d-8105-05291fb7f819 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1510 microversion: 2.1 time: 0.225180 Sep 09 12:15:25.058944 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 180/364] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:24 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:25.373631 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:25.374937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:25.376773 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:25.377621 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:25.387611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.388327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.388785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.389463 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.389911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.390509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.611696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.627285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.628754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.629951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cf4200cb-de34-486a-a283-45aeee098ccb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.260232 Sep 09 12:15:25.630697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 185/365] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:25 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:25.650513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:25.651487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:25.654880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:25.667233 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.667895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.670732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.672004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.673325 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.675407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.846982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.858919 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4953bf65-2029-49ae-a8b4-86794c90008c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.213037 Sep 09 12:15:25.859995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 181/366] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:25 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:26.083119 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:26.084767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:26.091900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.092602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.093212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.094218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.094809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.095293 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.267239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:26.278879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3c344268-73d9-44c9-9977-352a0ea522d6 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1516 microversion: 2.1 time: 0.201262 Sep 09 12:15:26.280102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 186/367] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:26 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:26.352388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1692939916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2045061559", "security_groups": [{"name": "tempest-secgroup-smoke-1731173038"}], "networks": [{"uuid": "32ebb1ca-3c09-46f3-b097-1580266e0d8d"}], "block_device_mapping_v2": [{"uuid": "9c8d4bd9-6f9b-4a9e-9ad1-3d6d88b003f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:26.680086 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:26.681109 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:26.691319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.691592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.692043 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.696243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.697650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.698178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.859054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] validate_networks() for [('32ebb1ca-3c09-46f3-b097-1580266e0d8d', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:15:26.995707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.003995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.005437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.007218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d4d4131c-41ba-4253-89f5-6b94ed648045 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.336201 Sep 09 12:15:27.007777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 187/368] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:26 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:27.012580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:27.013375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:27.019298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.020071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.020506 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.021203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.021693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.022118 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.231230 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.240850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c807c6fb-257e-4c23-8b54-275175a1d848 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.231421 Sep 09 12:15:27.241419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 188/369] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:27 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:27.357050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:15:27.357539 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:15:27.357928 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:15:27.358339 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:15:27.358746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:15:27.368966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.369451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.370100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.371011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.371467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.371895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.389916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Getting quotas for project 6b0570ae08fc40ccb3dd942591098d34. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:27.393954 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Getting quotas for user 9750f671d674447f9fbf36d382573c37 and project 6b0570ae08fc40ccb3dd942591098d34. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:27.456316 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:15:27.458455 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c8d4bd9-6f9b-4a9e-9ad1-3d6d88b003f9',volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:15:27.608346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-590dca64-cc1f-45e8-ba85-aa85db9265a4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259853 Sep 09 12:15:27.608996 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 182/370] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:15:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:15:27.624811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8c900e80-4c9c-4e69-b274-717cce34f1bc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:27.625863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8c900e80-4c9c-4e69-b274-717cce34f1bc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:27.696998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8c900e80-4c9c-4e69-b274-717cce34f1bc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.701855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8c900e80-4c9c-4e69-b274-717cce34f1bc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1089 microversion: 2.1 time: 0.080871 Sep 09 12:15:27.702422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 189/371] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:27 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:28.032527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:28.033145 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:28.039606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.040094 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.040528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.041219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.041844 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.042259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.191263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.200244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.201697 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.202850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8684c462-87ee-408e-ade5-82586b9aaef8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.174241 Sep 09 12:15:28.203433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 183/372] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:28 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:28.263815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:28.264425 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:28.270922 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.272064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.272433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.273129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.273588 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.274021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.404836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.412581 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2a0daebb-6aad-49b8-8b5a-4c3478758358 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.152736 Sep 09 12:15:28.413148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 190/373] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:28 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:28.731073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:28.731688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:28.748808 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.749392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.749844 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.752049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.752643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.753074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.847773 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.857555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-913ec855-7ffb-4c1c-8a18-6101130ec358 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1187 microversion: 2.1 time: 0.130691 Sep 09 12:15:28.875210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 184/374] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:28 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1187 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:29.231528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:29.233591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:29.240589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.241305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.241732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.242440 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.242916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.243352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.421830 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.436102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.436323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:29.436990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:29.438542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.440264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a8e3aa5b-1aee-4dfb-b8d4-0504d9218fc6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.215020 Sep 09 12:15:29.445595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.446358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.447009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.448003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.448601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.449224 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.455119 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 191/375] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:29 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:29.611614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.622583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5f7a3b45-ec8c-4ce1-89ab-0c25571295d1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.191168 Sep 09 12:15:29.623187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 185/376] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:29 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:29.883172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:29.884046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:29.891375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.892012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.892526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.893313 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.893850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.894372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.004154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.012853 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-30d7db2f-57b0-4c61-8ae5-40fa3b4c0093 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1195 microversion: 2.1 time: 0.134588 Sep 09 12:15:30.017383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 192/377] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:29 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1195 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:30.472388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:30.473751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:30.483323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.484125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.484995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.486096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.486801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.487595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.658639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:30.659302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:30.669927 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.670444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.670871 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.679953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.680441 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.680890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.758990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.772617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.777206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.781745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f1708a3c-22f2-4e0e-be78-be4e5e1df4b6 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.312583 Sep 09 12:15:30.795402 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 186/378] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:30 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:30.918866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.929609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-65fb822f-d286-407b-a88d-d2eb42eadd0c tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.284225 Sep 09 12:15:30.943691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 193/379] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:30 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:31.057795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:31.059440 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:31.067334 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.068036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.068797 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.070022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.071365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.071828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.151977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:31.163916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-22126d86-aeeb-4663-b125-88b6fe8d6a8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1205 microversion: 2.1 time: 0.113818 Sep 09 12:15:31.165719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 187/380] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:31 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1205 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:31.291400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8a001f5a-8f22-4558-a790-7d5f2dc161c0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: .version_select at 0x7f6bd104b280>, body: {"keypair": {"name": "tempest-keypair-1350184455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmtDi3Og0qAfjXoPmxXDARTYr8rgMf8ZwesgZ83vO47l8DQAD1h6VteOIkzSa0G38gyC9liMR98FbZgH3Kp4a7JgOcsYXUPj7+Hfv7BcJ2wvOumswmJ1iI/NWtuMaGWAg=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:31.331495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-8a001f5a-8f22-4558-a790-7d5f2dc161c0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:31.359845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-8a001f5a-8f22-4558-a790-7d5f2dc161c0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for user 31411178e5c342b7bb14a21dec62f540 and project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:31.398496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8a001f5a-8f22-4558-a790-7d5f2dc161c0 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112205 Sep 09 12:15:31.399547 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 194/381] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:15:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:31.810326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:31.812469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:31.836687 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.837577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.839588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.844501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.848803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.850530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.957061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:31.957844 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:31.976411 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.976964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.981725 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.983870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.986283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.996955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.144482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.159621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.167033 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.170495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1b8ea871-72c8-4881-b9a0-123981c7bf64 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.365372 Sep 09 12:15:32.175258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 188/382] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:31 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:32.190194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:32.191175 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:32.219855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.220372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.220812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.221867 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.222343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.222774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.443827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.458120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-91b5e650-1960-4e49-89c2-79dddfdf2dbd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.503595 Sep 09 12:15:32.473240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 195/383] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:31 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:32.532725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.546791 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c113dbf2-42c0-4c11-b09c-2ad7d89b2b9a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.360175 Sep 09 12:15:32.548604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 189/384] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:32 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:33.202417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:33.204060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:33.213130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.213861 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.214568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.215510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.216147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.216807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.485914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:33.487171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:33.502216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.505156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.507702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.510196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.511597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.513740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.549302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:33.585325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:33.597074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:33.602211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-39a1f7f1-6bed-438a-b343-989c960d2f8a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.404614 Sep 09 12:15:33.606298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 196/385] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:33 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:33.655115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:33.656182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:33.663682 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.664962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.665617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.666521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.682360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.684199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.969667 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:33.982206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-63368657-dcb6-4be1-b350-f9444712ddab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.500714 Sep 09 12:15:33.987011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 190/386] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:33 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:34.003996 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:34.029529 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:34.030301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:34.030979 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.072687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.087123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-73c6f9a1-c05d-45ae-ae53-98391c17c752 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.479313 Sep 09 12:15:34.088712 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] Creating event network-changed:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:15:34.089583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 197/387] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:33 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:34.097019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-89957cd8-9875-44cb-a08f-23532708fb7c req-77caa70a-e223-4ad7-98b4-5a35a7f16e72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108260 Sep 09 12:15:34.098636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 191/388] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:34.636130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:34.638283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:34.661510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:34.662673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:34.663430 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.664604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:34.664604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:34.665019 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.872251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.884408 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.886111 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.887472 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b8a849dd-1e06-49bf-86ca-ddf13ac63c15 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.261294 Sep 09 12:15:34.888366 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 198/389] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:34 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:35.017659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:35.018367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:35.028472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.029142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.030119 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.031010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.031782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.032414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.113477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:35.114475 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:35.125819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.126574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.127216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.128082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.128693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.134622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.329606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.340192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f59b1ad7-f3b6-433e-bef1-6f8b6c8a2394 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.328317 Sep 09 12:15:35.354935 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 192/390] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:35 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:35.354935 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-649048678", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65714226-b20a-40f8-a3ab-67b8f1e1b80d"}], "security_groups": [{"name": "tempest-securitygroup--1403340135"}], "key_name": "tempest-keypair-1350184455", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:35.391392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.402231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-240a1392-a9f1-4ffa-ba5a-768732780cb4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.292470 Sep 09 12:15:35.402848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 199/391] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:35 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:35.501544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] validate_networks() for [('65714226-b20a-40f8-a3ab-67b8f1e1b80d', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:15:35.914154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:35.914838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:35.923372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.923880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.928847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.929638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.930123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.930566 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.051933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:15:36.054141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:15:36.054141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:15:36.054141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:15:36.054141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:15:36.063221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.063828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.064132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.065066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.065701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.066313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.091845 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:36.096556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Getting quotas for user 31411178e5c342b7bb14a21dec62f540 and project edbc1c04ea364f3bb335fd4ad0731d1b. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:36.113181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:15:36.118434 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:15:36.136747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.145650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.148125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.149521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-55abf63b-14e9-4098-a42f-dd188703b7a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.239966 Sep 09 12:15:36.162534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 200/392] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:35 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:36.197184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-52bbf3f6-0e32-4a07-8de8-af0d168c5fce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.851874 Sep 09 12:15:36.211530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-878cdd1a-77c2-4b85-8781-ff342c903c58 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:36.211984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 193/393] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:15:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:15:36.215058 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-878cdd1a-77c2-4b85-8781-ff342c903c58 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:36.300177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-878cdd1a-77c2-4b85-8781-ff342c903c58 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.308811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-878cdd1a-77c2-4b85-8781-ff342c903c58 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1245 microversion: 2.1 time: 0.103887 Sep 09 12:15:36.319481 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 201/394] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:36 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:36.368472 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:36.369419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:36.380813 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.389740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.390442 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.392028 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.392851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.393480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.431740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:36.432317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:36.443768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.444210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.445127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.446124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.446784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.447573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.714730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.725152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.727502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4e4bf9c4-51ae-4bb8-b202-73a2af316988 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.305888 Sep 09 12:15:36.728329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 202/395] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:36 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:36.734256 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5384751d-77c0-44ab-8a59-1f6c18fdb6ba tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.370668 Sep 09 12:15:36.735524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 194/396] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:36 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:37.179507 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.180925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.187521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.188517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.189341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.190253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.190973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.191612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.333483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.334096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.346113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.347516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.348189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.349167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.350142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.353842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.358549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.363933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.366084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.371046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c3129239-7895-4f6b-b33c-5fe4b55678ea tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.194114 Sep 09 12:15:37.372072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 203/397] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:37.431260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.448669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd1e89b0-a339-43dc-86f7-42db3ac7ffb7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1249 microversion: 2.1 time: 0.118973 Sep 09 12:15:37.449174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 195/398] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1249 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:37.695403 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49cbcd0c-7039-4918-a52c-75870c5b8000", "name": "network-vif-plugged", "status": "completed", "tag": "9b077fb5-abd1-479a-9b92-689ddd0746ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:37.713742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.714577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.715455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.721956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:37.741902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] Creating event network-vif-plugged:9b077fb5-abd1-479a-9b92-689ddd0746ee for instance 49cbcd0c-7039-4918-a52c-75870c5b8000 on hv-cinder-85221 Sep 09 12:15:37.751720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.752595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.761231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.763485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.764158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.766983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.768387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.771446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.779925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-008ed911-c575-4e72-8de3-9f83094e6a15 req-0c7e5537-5205-41db-b356-d6c7865b5cc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088552 Sep 09 12:15:37.785176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 204/399] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:37.806225 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.806815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.825390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.826598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.828118 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.829260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.830695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.832400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.041750 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.053440 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b8093ba7-4e24-401f-b753-7e99789c14ad tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.306994 Sep 09 12:15:38.055255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 196/400] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:38.354975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.363302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-38b5acb2-ee25-4ee9-8a6d-d294c1604ec1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.571849 Sep 09 12:15:38.365089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 205/401] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:38.399789 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.400906 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.408084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.408912 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.409734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.410843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.424309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.425041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.477689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.478680 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.488538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.489251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.490780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.491796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.492409 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.492992 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.624739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.641641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8bff7810-3f5b-4073-9969-07b2ef6e7f99 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1297 microversion: 2.1 time: 0.169156 Sep 09 12:15:38.642875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 206/402] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1297 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:38.703514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.714033 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.717495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.719073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6e7fb87c-5bc1-4822-aaa2-064e509685f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.323755 Sep 09 12:15:38.720187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 197/403] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:39.077908 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:39.078519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:39.109132 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.109936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.110332 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.111268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.111878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.112455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.285342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.294639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a76977b3-4ad8-460e-a3b1-4e3961e6a9cc tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.220588 Sep 09 12:15:39.295644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 207/404] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:39 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:39.389859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:39.390481 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:39.397453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.397949 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.398561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.399489 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.399945 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.401011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.419772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:39.556312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.565204 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a2796b41-87b1-4d78-a422-8f390b61f19a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1366 microversion: 2.1 time: 0.179372 Sep 09 12:15:39.566029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 198/405] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:39 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:39.669145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:39.669944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:39.676395 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.677669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.678116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.679377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.679848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.680459 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.749626 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.752035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:39.753563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:39.758253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e1f8eaa5-b7cc-446f-a852-ec4a63724094 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1297 microversion: 2.1 time: 0.093075 Sep 09 12:15:39.758837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 208/406] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:39 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:39.772685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.773884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.774695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.775674 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.776216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.776726 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.944639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.954002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.956547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.958143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b28d7801-659e-4a2f-b0de-1f071c032412 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1745 microversion: 2.20 time: 0.210259 Sep 09 12:15:39.991954 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 199/407] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:39 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:40.317762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.318474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.329947 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.330367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.330805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.331581 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.332449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.333048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.490256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.499116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-86f550f5-fcb7-455c-879e-63f66e4c7b47 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.185164 Sep 09 12:15:40.499698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 209/408] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:40.590222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.590923 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.597635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.598366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.598948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.599649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.600096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.600686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.785209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.787443 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.802555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.807836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.809024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.811124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.812509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.814586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.815440 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.824502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f9984308-42aa-4adc-916d-c592c0438f24 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1555 microversion: 2.1 time: 0.238576 Sep 09 12:15:40.825519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 200/409] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:40.854559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.855450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.862733 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.863596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.864539 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.865418 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.866187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.866767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.951811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.966423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fada3e32-b47c-4656-aef0-47176362bef7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1315 microversion: 2.1 time: 0.187102 Sep 09 12:15:40.967043 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 210/410] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:40.989376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.989376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.997387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.997887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.998330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.999065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.999526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.999949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.028680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a3825743-8eee-4302-b42f-931a38c76c09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178906 Sep 09 12:15:41.029278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 201/411] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:41.342391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.351856 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.353337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.354530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c60e9cc4-1e86-4421-9845-153913d54ebe tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1745 microversion: 2.20 time: 0.371793 Sep 09 12:15:41.355126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 211/412] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1745 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:41.525540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:41.526777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:41.539642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.540580 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.541523 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.543041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.543795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.544728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.866121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.879639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a545b6df-f2f1-4951-8d9c-d2f696b27b63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.361016 Sep 09 12:15:41.888424 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 202/413] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:41 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:41.997155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:41.997755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:42.012477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.012977 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.017592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.018424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.018993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.022953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.246597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:42.260644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-72b3d801-4a04-4eba-a79d-cf8fa7f735af tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1303 microversion: 2.1 time: 0.267154 Sep 09 12:15:42.276075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 212/414] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:41 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:42.383255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:42.384142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:42.405114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.405619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.406056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.406764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.407242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.407655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.906244 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:42.907272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:42.924090 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.925051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.926541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.928124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.929902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.931209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.972455 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.003428 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.013123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.019429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5778b4c7-d750-4e03-8718-343048bb2df0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.639415 Sep 09 12:15:43.020045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 203/415] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:42 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:43.291559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:43.292606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:43.302378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:43.315036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.315861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.318461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.319721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.321436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.326978 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.606379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.622266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f1c94938-16ba-48d1-a417-bb06d6b0a9a5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.714836 Sep 09 12:15:43.622933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 213/416] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:42 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:43.798562 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:43.821269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.823449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.824519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.854976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] Creating event network-changed:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:15:43.868330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-d6210a97-378e-4e94-93a2-091f8382e5ec req-e90f96e4-6aea-4c2c-9761-7f8c52238757 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074885 Sep 09 12:15:43.871608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 214/417] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:44.041583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "name": "network-vif-plugged", "status": "completed", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:44.071007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.078061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.081354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.123774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] Creating event network-vif-plugged:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:15:44.148743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-f08392af-b69c-4aa1-ac8a-de52141b1c83 req-2fcc6493-79f9-42e2-a808-3504ffb1aad4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111214 Sep 09 12:15:44.149869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 215/418] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:44.165152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:44.168896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:44.209295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.210640 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.211286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.212261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.213042 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.213663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.985232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.001656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d0f06dcc-e751-4362-8185-42277d92ef96 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 1.714080 Sep 09 12:15:45.005825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 204/419] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:43 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:45.014701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:45.029640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:45.070617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:45.073904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:45.075425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.076399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:45.077741 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:45.078412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.525969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.553960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.560298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.565506 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-90e08459-5f13-464c-839b-ce595cabaffa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 1.414395 Sep 09 12:15:45.570032 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 216/420] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:44 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:45.592275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49cbcd0c-7039-4918-a52c-75870c5b8000", "tag": "9b077fb5-abd1-479a-9b92-689ddd0746ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:45.612900 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:45.615513 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:45.618457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.705118 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] Creating event network-changed:9b077fb5-abd1-479a-9b92-689ddd0746ee for instance 49cbcd0c-7039-4918-a52c-75870c5b8000 on hv-cinder-85221 Sep 09 12:15:45.712678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-474d2cde-c749-472f-a07c-679c6149fca6 req-532fa19f-9c36-4b80-a2e3-d228621ebc9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140358 Sep 09 12:15:45.716356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.727030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 217/421] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:45.743432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-20d8311a-6cfa-4b4a-880d-c616db6d0c5f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.728317 Sep 09 12:15:45.744292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 205/422] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:45 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:46.030994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:46.032071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:46.055865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.056961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.057565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.058743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.059220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.075207 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.308898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=8 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:46.372301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:46.382865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d46e92f7-53c8-437d-8b43-0d9984f34720 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.355193 Sep 09 12:15:46.384892 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 218/423] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:46 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:46.597303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:46.597881 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:46.607304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:46.612361 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=12 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:46.614825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.615894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.617091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.619641 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.620322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.622370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.766802 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:46.767997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:46.790003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.790839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.791610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.793818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.795982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.798191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.337597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.350609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4f20be1f-2dd1-4995-8c11-41818ad97e62 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.587724 Sep 09 12:15:47.354028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 219/424] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:46 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:47.382607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.393904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.396000 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.398123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed518308-5ed2-4d8d-9598-b324c8a2e06a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.805281 Sep 09 12:15:47.405076 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 206/425] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:46 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:47.408796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:47.409610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:47.418114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.420872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.422847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.431268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.432073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.432697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.661677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.673470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-77255cdf-3c51-4e79-912f-b666d8bc216d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.268896 Sep 09 12:15:47.678387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 220/426] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:47 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:48.378571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:48.378571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:48.385164 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.385664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.386106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.387150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.387566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.388327 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.444014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:48.454424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:48.472538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.474439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.475175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.476185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.476873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.477422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.697355 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.712389 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5cecd956-79c2-472a-b9b3-daa9f6f970ba tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.339803 Sep 09 12:15:48.717514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 207/427] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:48 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:48.741454 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:48.742329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:48.751997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.755820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.756742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.759910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.760584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.761218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.762003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.781129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.787709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.790461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-613caa2f-bca8-44d4-b19c-449130943968 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.370130 Sep 09 12:15:48.795384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 221/428] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:48 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:48.955092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.975734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-56331afa-8f6c-46f9-a331-011377bb5a30 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.253898 Sep 09 12:15:48.976360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 208/429] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:48 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:49.746044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:49.746847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:49.758135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.758941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.759366 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.760058 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.771454 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.772173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.821447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:49.822813 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:49.830209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.830894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.831498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.832352 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.833245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.833865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.165183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.191288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.197845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-33c15e56-7035-4568-adfa-29457c3ba8b4 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.456209 Sep 09 12:15:50.198469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 222/430] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:49 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:50.209224 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.210688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.216686 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "name": "network-vif-plugged", "status": "completed", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:50.230638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-faf1343b-7cf2-4b2e-b687-ed8ccbcafc67 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.413099 Sep 09 12:15:50.232765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 209/431] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:49 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:50.250114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:50.250726 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:50.256708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.257186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.264289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.276858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.277646 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.278827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.288075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.288768 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.289356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.301038 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] Creating event network-vif-plugged:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:15:50.311160 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-dc8a998d-d6e4-4f96-93e4-210d11753a7a req-d002498f-293f-4e6e-8387-f640f0159249 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098523 Sep 09 12:15:50.313990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 223/432] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:50.555216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.565203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb0a07eb-27aa-44b6-95f6-e91ab8664130 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.330494 Sep 09 12:15:50.581671 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 210/433] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:50 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:51.226805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:51.227665 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:51.236392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.237188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.237786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.238510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.239183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.240379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.260738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:51.261330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:51.275223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.276218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.276879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.278995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.280488 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.280921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.287984 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:51.525690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.547266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.549650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-622daa89-3bc7-4e5b-a1e2-49aae00ad86b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.329325 Sep 09 12:15:51.557207 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 224/434] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:51 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:51.559236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.561163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.565917 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7f6f842b-c25b-401c-819d-7add1f483cb7 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.309488 Sep 09 12:15:51.567215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 211/435] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:51 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:51.592878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:51.593793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:51.608027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.608749 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.609432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.610303 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.610933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.611516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.841139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.850401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7305affe-8126-4d70-8740-35d79d3551c7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.264584 Sep 09 12:15:51.863422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 225/436] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:51 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:52.329423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "name": "network-vif-plugged", "status": "completed", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:52.340895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.341719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.342243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.356974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] Creating event network-vif-plugged:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:15:52.363018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-8a8b818b-7a5b-4a48-8457-7358be1a9c8d req-f8cb827c-f754-4278-bac8-dcf8e46a6d33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037509 Sep 09 12:15:52.363953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 212/437] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:52.607904 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:52.608641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:52.618158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:52.619110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.619809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.620426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.621359 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.621982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.622558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.623479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:52.655762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.656327 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.656982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.657781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.666306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.667336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.885819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:52.900845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-32981562-d3dd-40ae-9fa4-d9e8904e8d18 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1261 microversion: 2.1 time: 0.307908 Sep 09 12:15:52.917197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 226/438] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:52 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:52.925353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:52.932162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:52.943714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:52.945519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.946209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.951821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.952816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.953435 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.954026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.091806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.102877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.106604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.108068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0642c4b5-fe88-411a-86bc-ab74c2748785 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.501849 Sep 09 12:15:53.110451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 213/439] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:52 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:53.260916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.273203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dc3b3a4b-0b3f-42c9-8921-9a2ca73b1047 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.354545 Sep 09 12:15:53.275990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 227/440] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:52 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:53.925604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:53.927096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:53.936272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.937049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.937651 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.938351 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.938811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.939312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.126189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.142459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5638dd5d-21ab-4462-a7b6-b39acf28774d tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1444 microversion: 2.1 time: 0.221366 Sep 09 12:15:54.143068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 214/441] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:53 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1444 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:54.145264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:54.146075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:54.152181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.152687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.153476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.154177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.154662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.155119 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.167484 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:54.168448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:54.183256 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.184939 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.185594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.186495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.187180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.187809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.438350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.447935 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.457164 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.460602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.462787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ccc6a23e-ea19-4472-85df-35ad2aec7998 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.321965 Sep 09 12:15:54.468475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fbb104da-bf9f-4708-a756-58709ace8598 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1444 microversion: 2.1 time: 0.304535 Sep 09 12:15:54.469816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 215/442] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:54 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1444 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:54.475697 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:54.476603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:54.479890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 228/443] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:54 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:54.484044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.485474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.486301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.487276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.488196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.488767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.492050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:54.670342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.680707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b4421e52-406e-4955-af31-49253c3ad049 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1371 microversion: 2.1 time: 0.209533 Sep 09 12:15:54.681787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 216/444] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:54 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:55.490133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:55.491536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:55.499428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.503611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.505162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.507658 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.508151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.508593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.714705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:55.716022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:55.729619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.730186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.730757 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.737651 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.738224 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.738719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.868815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.900093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.901760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.903100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c372cae0-9439-4480-b33a-4b054eae1101 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.417643 Sep 09 12:15:55.906418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 229/445] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:55 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:56.091279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:56.106482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d993b11e-839f-4f13-b4a5-bf86a02c7692 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1566 microversion: 2.1 time: 0.397410 Sep 09 12:15:56.107376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 217/446] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:55 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:56.131027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:56.131815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:56.141716 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:56.145868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:56.146622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:56.147593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:56.148288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:56.148874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:56.323888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e45f8f0b-b419-4bda-85cf-e321b2852a8f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196870 Sep 09 12:15:56.332630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 230/447] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:15:56 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:56.935811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:56.936975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:56.950020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:56.950735 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:56.951278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:56.952168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:56.952700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:56.953208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:57.887221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:57.896670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:57.903231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:57.904888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-69c2fa69-303e-4c43-a040-279791834a0e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.973827 Sep 09 12:15:57.909521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 218/448] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:56 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:58.946397 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:58.949886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:58.981078 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:58.982271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:58.985450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:58.987750 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:58.990290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:58.991277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:59.084902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:59.108837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:59.109892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:59.110748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:59.142892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] Creating event network-changed:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:15:59.160156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-c9fb0bc8-095e-47f9-b66b-df902d560196 req-2a3f3661-bd16-4062-a1b1-857d53c65e28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093178 Sep 09 12:15:59.161852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 219/449] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:59.461338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:59.476073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:59.477554 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:59.488249 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c4e9efca-d3a3-49b3-bc6d-4ecf5c972acd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1740 microversion: 2.20 time: 0.554148 Sep 09 12:15:59.489578 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 231/450] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:58 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1740 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:00.518306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:00.519244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:00.541202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.541808 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.542271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.543213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.543820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.544392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.887250 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:00.897065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:00.898545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:00.899805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-62838680-c54e-4a0f-a75d-9e9e0684b94c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1722 microversion: 2.20 time: 0.388246 Sep 09 12:16:00.900378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 220/451] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:00 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1722 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:01.199793 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:01.211938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:01.212421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:01.212847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:01.231065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] Creating event network-changed:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:16:01.237691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-6b97007e-bc68-4f32-92ca-a76bfd62e542 req-469c9359-251f-472d-b448-db745075367d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041522 Sep 09 12:16:01.238764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 232/452] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:16:01.926975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:01.928466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:01.941068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:01.943913 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:01.944128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:01.944937 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:01.946638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:01.947263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:02.211385 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:02.227038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:02.228516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:02.229953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-58586ce6-9409-42bf-8232-8d85433024f1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1722 microversion: 2.20 time: 0.307853 Sep 09 12:16:02.230551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 221/453] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:01 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:03.260002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:03.260835 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:03.271684 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.272005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.273195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.274158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.275395 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.276110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.521351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.536445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.538284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.539655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a87ec97c-33ee-47ad-8530-538ef537b059 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1725 microversion: 2.20 time: 0.286136 Sep 09 12:16:03.555688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 233/454] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:03 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:03.568668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd5a093-2de8-4b14-81e4-272fcc6c7651"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:03.572262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:03.581208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.582842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.583503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.584449 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.585072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.585814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.011267 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "name": "network-vif-unplugged", "status": "completed", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:04.028650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.030302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.031296 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.044157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ee89fc85-7293-4a9e-8726-be02c451b163 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.481000 Sep 09 12:16:04.045959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 222/455] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Sep 9 12:16:03 2022] POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments => generated 188 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:16:04.047669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.compute.server_external_events [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] Unable to find a host for instance 578576a5-5165-4c3b-b095-1ca6461b2610. Dropping event network-vif-unplugged {{(pid=120591) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 12:16:04.049114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-8af0f142-b0de-4995-87cf-97e3bdac94b5 req-871eab8d-c590-4ba8-b521-9e33743924f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042393 Sep 09 12:16:04.050946 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 234/456] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 12:16:04.231642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:04.232249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:04.239097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.239364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.240214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.240831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.241296 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.241873 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.309719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:16:04.455024 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-63022eb5-b0c0-40cb-9c92-6b77c05041e4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/action" status: 202 len: 0 microversion: 2.20 time: 0.227304 Sep 09 12:16:04.455553 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 223/457] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 9 12:16:04 2022] POST /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:16:04.468098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:04.469564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:04.478022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.478760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.480734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.484891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.486125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.487236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.749937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:04.766633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:04.768348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:04.771055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-543a3e1a-fca1-4659-8cd0-004d98ee169b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1751 microversion: 2.20 time: 0.310084 Sep 09 12:16:04.773791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 235/458] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:04 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1751 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:05.797502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:05.798124 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:05.805138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.805867 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.806465 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.807661 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.808278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.808895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:06.059807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:06.071716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:06.099294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:06.102131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c12b95b3-3c12-4d6e-8680-7ff7b7d512e0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1751 microversion: 2.20 time: 0.308675 Sep 09 12:16:06.110593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 224/459] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:05 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1751 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:07.134536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:07.135263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:07.142128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:07.143034 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:07.144874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:07.145880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:07.146816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:07.147379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:07.438212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:07.455991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:07.471586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:07.474571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c886cbcf-87a7-41e4-886d-248e6346ddf3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1753 microversion: 2.20 time: 0.343783 Sep 09 12:16:07.475364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 236/460] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:07 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1753 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:08.507276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:08.507859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:08.539158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:08.539893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:08.540603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:08.541344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:08.541801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:08.542226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:08.742330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:08.808294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:08.833035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:08.837795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9198ba4a-a688-41d1-8158-fa6c53cdffab tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.335026 Sep 09 12:16:08.840402 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 225/461] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:08 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:09.871842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:09.872539 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:09.882397 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.883093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.883535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:09.884246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.885010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.885607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:10.058340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:10.073997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:10.075489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:10.076864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-27cb9d92-5500-400c-99e9-8ac45880e6cc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.210859 Sep 09 12:16:10.091482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 237/462] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:09 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:11.106582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:11.107250 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:11.116025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:11.116875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:11.117385 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:11.118433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:11.119386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:11.120094 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:11.278518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:11.289926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:11.291765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:11.293032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2af87578-f55e-4a7b-b74a-cc6a22a74a6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.190961 Sep 09 12:16:11.293686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 226/463] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:11 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:12.321470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:12.322679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:12.329638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:12.330400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:12.331052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:12.332126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:12.332776 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:12.333339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:12.529635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:12.539003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:12.540459 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:12.541640 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1ad4bbf2-de95-46eb-a095-9fa70d13d29f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.224233 Sep 09 12:16:12.555253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 238/464] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:12 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:13.574584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:13.575825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:13.578650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:13.585880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.586667 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.587142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:13.587872 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.588476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.588905 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:13.789430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:13.800716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:13.802537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:13.810676 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4a88efd7-4424-49e8-9ce3-e214dcbaddb8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.242836 Sep 09 12:16:13.811546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 227/465] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:13 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:14.841007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:14.845448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:14.864601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:14.880007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:14.881006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:14.881940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:14.882567 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:14.884917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.073003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:15.086767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:15.088279 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:15.089596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7de8450e-8e0b-4e62-886d-b974e02d4174 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.254586 Sep 09 12:16:15.090157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 239/466] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:14 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:16.126774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:16.130706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:16.138091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:16.138658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:16.139186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:16.139957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:16.140474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:16.141324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:16.302171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:16.313711 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:16.316451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:16.317607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-95b90627-54d6-43e9-a52e-0fa56db78916 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.195884 Sep 09 12:16:16.318352 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 228/467] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:16 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:17.350175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:17.351753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:17.371634 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.372474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.373359 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.374245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.374703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.375333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.751747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:17.761511 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:17.763413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:17.765111 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-63e78408-3c96-4f80-bf53-c27352362add tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.420055 Sep 09 12:16:17.779598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 240/468] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:17 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:18.745752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0950c168-f312-43d7-b90d-8a8240e6dbce tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'create', calling method: .version_select at 0x7f6bd0cd3940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-864059863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbvxXIUyyBWtVezpTrINupckEg/Ei6aWAL2/lppJvyQmKXxhTFGI5R95W1a2RgFiilMulZ40ihsx4inPt3MeHdLfc5XlQLCcQYHFZrHtv5HU5gMQpsZzEK9IaPomwm2Gg=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:18.777519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-0950c168-f312-43d7-b90d-8a8240e6dbce tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Getting quotas for project baec172d59054da499387e85a4b8727e. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:16:18.782609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-0950c168-f312-43d7-b90d-8a8240e6dbce tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Getting quotas for user eb42a8cde3044a4b9df5cb81d82d9910 and project baec172d59054da499387e85a4b8727e. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:16:18.793051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:18.793693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:18.804991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:18.805495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:18.805938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:18.806750 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:18.807675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:18.808103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:18.812113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0950c168-f312-43d7-b90d-8a8240e6dbce tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.075325 Sep 09 12:16:18.812927 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 229/469] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:16:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:18.872942 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1475162233", "imageRef": "db9c6d38-671d-4903-9762-14589f375c62", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-864059863", "networks": [{"uuid": "140a8beb-bb0c-4673-808f-2c21800a5013"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:18.933131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] validate_networks() for [('140a8beb-bb0c-4673-808f-2c21800a5013', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:16:19.294248 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:19.304622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:19.306087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:19.307565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-21d80555-ef06-4b7a-b895-ddd3b683ba6c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.518141 Sep 09 12:16:19.308488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 241/470] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:18 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:19.616324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:16:19.616751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:16:19.617419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:16:19.617835 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:16:19.618249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:16:19.627318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:19.628932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:19.629447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:19.630265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:19.630814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:19.631336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:19.649652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Getting quotas for project baec172d59054da499387e85a4b8727e. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:16:19.656468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Getting quotas for user eb42a8cde3044a4b9df5cb81d82d9910 and project baec172d59054da499387e85a4b8727e. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:16:19.686269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:16:19.688670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db9c6d38-671d-4903-9762-14589f375c62',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:16:19.735499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e4284aeb-3576-4a5e-bff4-7cb6c0710b96 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866412 Sep 09 12:16:19.736144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 230/471] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:16:19.748004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5ce48d95-7f34-450f-85ac-e2563c674a46 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:19.749004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5ce48d95-7f34-450f-85ac-e2563c674a46 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:19.808352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5ce48d95-7f34-450f-85ac-e2563c674a46 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:19.817473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5ce48d95-7f34-450f-85ac-e2563c674a46 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1258 microversion: 2.1 time: 0.073278 Sep 09 12:16:19.818468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 242/472] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:19 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:20.334259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:20.334868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:20.341809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:20.342299 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:20.342746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:20.343469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:20.343933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:20.344528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:20.360464 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:20.486790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:20.496230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:20.497670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:20.498812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-321984b1-1a3b-422a-9982-2c1264fae09b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.169373 Sep 09 12:16:20.499397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 231/473] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:20 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:20.840059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:20.840693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:20.847526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:20.848018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:20.848457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:20.849174 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:20.849622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:20.850042 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:20.873347 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:20.923073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:20.930955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e1688bf5-f239-421f-9417-26baf4437803 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.094636 Sep 09 12:16:20.931530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 243/474] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:20 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:21.525468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:21.526066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:21.532551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:21.533035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:21.533473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:21.534178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:21.534630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:21.535170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:21.670274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:21.680177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:21.681606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:21.683042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aafe67ef-8289-44de-83ea-d51c63ef17a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.161597 Sep 09 12:16:21.683591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 232/475] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:21 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:21.954476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:21.955709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:21.964941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:21.965618 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:21.966065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:21.966785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:21.967270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:21.967696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:22.036961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:22.045478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0fa2e05f-8607-4a9e-a0d6-3aae4a80818d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.095587 Sep 09 12:16:22.046054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 244/476] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:21 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:22.709873 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:22.710530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:22.716875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:22.717356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:22.717791 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:22.718475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:22.718952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:22.719382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:22.871986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:22.881043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:22.882511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:22.883716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac5369d0-f31c-4828-a5cb-a1d21f81006e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.177797 Sep 09 12:16:22.884621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 233/477] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:22 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:23.069517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:23.070138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:23.072198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=38 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:23.077933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:23.078428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:23.079145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:23.079850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:23.080305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:23.081256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:23.142593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:23.151323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-841a3638-6f30-4bea-a069-db7910691054 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.086318 Sep 09 12:16:23.152116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 245/478] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:23 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:23.910378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:23.911095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:23.917861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:23.918369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:23.918805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:23.919548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:23.920006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:23.920436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:24.103865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:24.114031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:24.115503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:24.116670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-80bef630-c386-4f6e-8d77-97f8b73ce5cb tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.211143 Sep 09 12:16:24.117230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 234/479] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:23 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:24.173629 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:24.175274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:24.181754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:24.182593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:24.183131 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:24.184031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:24.184641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:24.185227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:24.251248 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:24.259794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b78006e8-9f90-4863-b293-266eb8ae8a83 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.090031 Sep 09 12:16:24.260374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 246/480] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:24 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:25.145426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:25.146279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:25.153416 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.154580 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.155052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.155791 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.156246 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.156670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.286989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:25.288508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:25.294488 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:25.295445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.296181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.296841 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.297779 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.298602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.300218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.304503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:25.306659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:25.308138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d214b89b-eec5-482a-b64d-d6ae07c77e48 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.169111 Sep 09 12:16:25.309090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 235/481] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:25 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:25.371217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:25.380106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5b5c590c-5ad4-42dc-b2e1-5c0a03887a56 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.097503 Sep 09 12:16:25.380683 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 247/482] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:25 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:26.344337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:26.344941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:26.351827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.352399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.352918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.353688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.354213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.354706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.404568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:26.405177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:26.415330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.415330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.415330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.415330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.415839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.415839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.494383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:26.502457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1fbd9ecc-d745-43be-a1c2-c975982515d4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.101485 Sep 09 12:16:26.503240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 248/483] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:26 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:26.541666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:26.552546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:26.554004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:26.555196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5c259d01-dd0a-41a1-9846-960c6af77e03 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.214838 Sep 09 12:16:26.555758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 236/484] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:26 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:27.526812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:27.527445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:27.534223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.535049 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.535496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:27.536192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.536652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.537064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:27.586441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:27.588070 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:27.595883 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.597420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.598009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:27.598718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.599361 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.599938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:27.627659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:27.650633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-79cf80b6-f9ac-4355-87c1-84de2e444c0a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1262 microversion: 2.1 time: 0.127487 Sep 09 12:16:27.651245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 249/485] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:27 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1262 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:27.755836 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:27.764733 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:27.766234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:27.767559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-53014a13-942d-475d-adf3-6fbe2a8dca35 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.185167 Sep 09 12:16:27.768842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 237/486] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:27 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:28.680477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:28.681017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:28.687319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:28.687805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:28.688245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:28.688959 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:28.689412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:28.689885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:28.754921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:28.763662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8d8ffbbc-4604-4b51-b96c-c32c60e60b39 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1310 microversion: 2.1 time: 0.087424 Sep 09 12:16:28.764692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 250/487] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:28 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:28.802215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:28.802927 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:28.809808 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:28.810293 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:28.810734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:28.811463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:28.811915 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:28.812505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:28.946676 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:28.955580 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:28.957035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:28.958306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2f39b7e9-99db-44c4-a597-c1707f94d401 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.161096 Sep 09 12:16:28.959083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 238/488] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:28 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:29.791169 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:29.791807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:29.799778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:29.800637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:29.801265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:29.802369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:29.803048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:29.803701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:29.831462 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:29.975628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:29.985254 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:29.989320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:30.000548 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cfe998a1-a6bd-41ba-aa81-96abbeed4ff0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.213566 Sep 09 12:16:30.003703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:30.004745 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 251/489] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:29 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:30.005814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=10 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:30.008381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:30.009044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:30.009649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:30.010527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:30.011239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:30.011817 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:30.341104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:30.352040 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:30.358315 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:30.359549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d6962e59-c66a-4f6c-82f2-61796c0f1e75 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.378683 Sep 09 12:16:30.363261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 239/490] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:29 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:16:31.030990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:31.031605 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:31.054173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.054700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.055190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.058417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.059027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.064789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.325990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:31.336111 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3fe447e6-7c18-4e10-892d-26d51efecf58 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.309885 Sep 09 12:16:31.343715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 252/491] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:31 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:31.388948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:31.389659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:31.397714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.398503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.399142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.400066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.400689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.401289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.599616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:31.613209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:31.620363 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.620854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.621284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.623859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:31.625579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:31.627144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f474c00c-d983-4a7d-b1e7-c7f030542f8e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.242794 Sep 09 12:16:31.628393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 240/492] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:31 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:31.639858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] Creating event network-changed:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:16:31.645870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b4085a55-1248-42b1-a323-6bfe723d7add req-61c2391b-26d1-4e48-b32f-4a228fd9790b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049968 Sep 09 12:16:31.647097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 253/493] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:16:32.362930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:32.365041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:32.373797 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.374281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.374710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.375438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.375889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.376307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.527224 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:32.536683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-29296762-8060-40bc-a365-00fe4f4c0286 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.178768 Sep 09 12:16:32.537273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 241/494] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:32 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:32.651211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:32.652088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:32.657594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:32.658403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:32.658981 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.659478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.659917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.660800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.661254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.661727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.665708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.666271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.666780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.667585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.668107 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.668617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.696387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-97a03a1e-1d67-44b9-ae11-ab1e09573d87 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/ips" status: 200 len: 149 microversion: 2.1 time: 0.049334 Sep 09 12:16:32.697559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 254/495] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:16:32 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:32.709544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6677887c-7448-4ba7-abc1-77af6f4b3482"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:32.712236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:32.718828 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.719619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.720235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.721156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.721768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.722205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.826976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:32.830480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/os-volume_attachments HTTP/1.1 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 74 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:16:32.832896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {"volumeAttachment": {"volumeId": "6677887c-7448-4ba7-abc1-77af6f4b3482"}} Sep 09 12:16:32.834569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'server_id': '49cbcd0c-7039-4918-a52c-75870c5b8000', 'body': {'volumeAttachment': {'volumeId': '6677887c-7448-4ba7-abc1-77af6f4b3482'}}} Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:32.835523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:32.837234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:32.839664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:32.839664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:32.839664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:32.839664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 Sep 09 12:16:32.839664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:32.840285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:32.840285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:32.840285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-87b08730-6378-4798-abcd-1ec97d2ed0f2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.186344 Sep 09 12:16:32.858890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 242/496] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:32 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:16:32.859210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 400 to user: Invalid volume: volume 6677887c-7448-4ba7-abc1-77af6f4b3482 is already attached to instances: df0cb5c6-89f6-4231-8311-7ddbe2693c70 {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:32.859210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-29cfe427-1f26-44f6-a4a4-b1ce9ba0ab93 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139592 Sep 09 12:16:32.859210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 255/497] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:16:32 2022] POST /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:16:32.859640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:32.859640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:32.867471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.867976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.868546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.869404 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:32.870194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:32.870719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:32.898172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:16:32.989291 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-449cbdce-87e5-48c9-be3d-964eac73bcab tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 204 len: 0 microversion: 2.1 time: 0.138826 Sep 09 12:16:32.989935 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 243/498] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:32 2022] DELETE /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:16:32.999954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:33.000568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:33.008352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.009094 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.009694 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.010568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.011217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.011803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.167321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:33.176892 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-810a865d-fded-4bb9-a93d-e95a7f7b95a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.180636 Sep 09 12:16:33.177810 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 256/499] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:32 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:33.560241 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:33.560964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:33.568074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.568569 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.569004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.569712 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.570161 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.570583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.716084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:33.724524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8525a58b-a69d-4a2f-8676-d2c06ff6220d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.168907 Sep 09 12:16:33.725184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 244/500] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:33 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:33.866643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:33.867277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:33.873432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.873925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.874368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.875106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.875570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.875999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.016570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:34.026156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:34.027643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:34.028812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-776568cf-f836-411f-be24-6ca989ea5477 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.166274 Sep 09 12:16:34.029358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 257/501] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:33 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:34.201702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.202347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.209222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.209800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.210354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.211190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.211648 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.212072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.379695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:34.388372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8a8f2aa9-84a8-40ac-864a-7dc7a3953ed5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.190484 Sep 09 12:16:34.389330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 245/502] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:34 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:34.748592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.749099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.755707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.756192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.756624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.757323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.757777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.758205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.896314 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:34.904602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a96f9890-75ca-4972-bcf8-634f778b1de1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.159900 Sep 09 12:16:34.905276 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 258/503] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:34 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:35.057966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:35.058535 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:35.066074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.066594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.067057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.067756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.068211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.068633 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.084782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:35.209533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:35.218530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:35.220163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:35.221673 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f8877b92-e372-400d-8a73-a3f85d40897c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.168690 Sep 09 12:16:35.242129 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 246/504] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:35 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:35.414819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:35.415941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:35.423202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.424434 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.424941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.425709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.426252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.426743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.569339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:35.577418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7f9ef0ab-b591-47fc-bae9-5049f9f9a347 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.167083 Sep 09 12:16:35.577994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 259/505] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:35 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:35.928218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:35.928819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:35.935158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.935636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.936060 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.936740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.937184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.937596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:36.102619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:36.110751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e1aed7bd-ab59-4f1d-ba25-f9d2ac1dad7c tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.186816 Sep 09 12:16:36.111703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 247/506] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:35 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:36.249392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:36.249995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:36.256687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:36.257194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:36.257615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:36.258317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:36.258770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:36.259229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:36.392483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:36.401388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:36.402940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:36.404151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-870b1aa9-f2fb-4694-9c5b-06549ec829fa tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.158763 Sep 09 12:16:36.404942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 260/507] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:36 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:36.602015 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:36.602564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:36.608885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:36.609374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:36.609807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:36.610505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:36.611078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:36.611513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:36.750761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:36.758786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e57a580a-8d99-4b75-b060-c69478f8c6f9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.160951 Sep 09 12:16:36.759394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 248/508] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:36 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:37.134053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:37.135002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:37.141184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.141680 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.142116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.143595 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.144157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.144604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.149312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:37.277401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:37.285097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-688f8db9-7a60-45e2-856e-8991e5d675e5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.154833 Sep 09 12:16:37.285657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 261/509] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:37 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:37.430624 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:37.431331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:37.438455 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.439021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.439990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.440663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.441118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.441544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.580143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:37.588820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:37.590258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:37.591469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7c160338-4b57-46e7-9446-c5372a7c2c28 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.165124 Sep 09 12:16:37.592029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 249/510] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:37 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:37.786269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:37.786932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:37.793400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.793923 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.794366 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.795098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:37.795559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:37.795993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:37.945611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:37.954037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2bcc939c-f715-4517-92bd-9df4eede85e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.172145 Sep 09 12:16:37.955221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 262/511] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:37 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:38.308366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:38.308964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:38.315709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.316186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.316612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:38.317290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.317744 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.318167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:38.454890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:38.462677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f448a271-f63a-42eb-aa85-cce080eca239 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.158472 Sep 09 12:16:38.463303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 250/512] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:38 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:38.617643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:38.618239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:38.624141 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.624636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.625057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:38.625731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.626179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.626751 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:38.761446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:38.770482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:38.771955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:38.773102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6ccd6389-f8e4-434c-986b-1bc8b5953bd4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.159439 Sep 09 12:16:38.773659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 263/513] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:38 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:38.978110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:38.978709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:38.984824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.985548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.986042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:38.986745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:38.987228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:38.987653 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:39.114880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:39.122594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0523dd06-9c85-4e74-81cb-50288a377120 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.148348 Sep 09 12:16:39.123184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 251/514] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:38 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:39.485937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:39.486460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:39.492336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:39.492819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:39.493253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:39.493939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:39.494392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:39.494817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:39.624404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:39.632720 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f5624b0c-5869-449b-a67d-32955ef9cfb8 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.150936 Sep 09 12:16:39.633297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 264/515] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:39 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:39.800004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:39.800812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:39.808386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:39.808988 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:39.809499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:39.810276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:39.810927 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:39.811424 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:39.941524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:39.950065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:39.951564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:39.952723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b6db5f52-0d0d-4461-8cd5-bd861d6fca27 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.157333 Sep 09 12:16:39.953283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 252/516] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:39 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:40.146976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:40.147526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:40.153503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.153993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.154433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:40.155158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.155617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.156041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:40.284950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:40.292629 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1cd90508-92e6-4f1f-92b5-3c7c69355d42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.150357 Sep 09 12:16:40.293197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 265/517] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:40 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:40.655777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:40.656421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:40.662702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.663225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.663689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:40.664368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.664848 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.665269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:40.797487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:40.805828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94553ba5-d221-48a3-b046-4bbf886f6f71 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.153907 Sep 09 12:16:40.806430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 253/518] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:40 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:40.977586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:40.978194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:40.984139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.984623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.985062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:40.985847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:40.986858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:40.987361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:41.116386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:41.125218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:41.127128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:41.128317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bc7b27f6-e348-4f7b-b0c9-2e9614909917 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.154617 Sep 09 12:16:41.128904 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 266/519] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:40 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:41.317030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:41.317549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:41.323463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:41.323943 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:41.324371 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:41.325071 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:41.325520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:41.325938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:41.462275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:41.471916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-23b2029a-cea0-4e03-aa30-f40d687c52bd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1680 microversion: 2.1 time: 0.159470 Sep 09 12:16:41.472496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 254/520] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:41 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:41.829705 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:41.830450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:41.836528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:41.837013 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:41.837445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:41.838143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:41.838597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:41.839060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:41.968100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:41.976070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f1bd8911-e046-444f-8083-1baced27394b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.150238 Sep 09 12:16:41.976636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 267/521] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:41 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:42.153557 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:42.154150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:42.161122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:42.161609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:42.162045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:42.162747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:42.163242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:42.163686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:42.298885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:42.308445 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:42.310009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:42.311584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6a493ce0-71a6-43c3-866f-4011bcb6ab88 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.161933 Sep 09 12:16:42.312372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 255/522] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:42 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:42.495284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:42.495980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:42.502071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:42.502576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:42.503024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:42.503714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:42.504163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:42.504583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:42.573294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:42.582142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-19b32a00-4ee6-4bbd-a47a-372590dd10cf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1613 microversion: 2.1 time: 0.090925 Sep 09 12:16:42.583065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 268/523] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:42 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:42.635790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49cbcd0c-7039-4918-a52c-75870c5b8000", "name": "network-vif-deleted", "tag": "9b077fb5-abd1-479a-9b92-689ddd0746ee"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:42.645916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:42.646473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:42.647203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:42.659677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] Creating event network-vif-deleted:9b077fb5-abd1-479a-9b92-689ddd0746ee for instance 49cbcd0c-7039-4918-a52c-75870c5b8000 on hv-cinder-85221 Sep 09 12:16:42.664745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-bc45bbd6-1441-406a-a927-c92b57937d68 req-71fa26eb-2c23-445a-af0c-05abcefd571c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Sep 09 12:16:42.665342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 256/524] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:43.010021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:43.011074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:43.018688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.019597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.020114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.020908 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.021424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.022072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.181738 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:43.201416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-befa8c27-70fe-4a03-bd71-e20335d8e815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.190290 Sep 09 12:16:43.202069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 269/525] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:43 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:43.343251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:43.343865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:43.351386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.352166 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.352598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.353316 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.353776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.354206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.513660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:43.523780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:43.525499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:43.526748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac2f316e-de40-419f-9d63-85fff37ddfcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.188834 Sep 09 12:16:43.527408 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 257/526] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:43 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:43.606482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:43.607206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:43.613777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.614275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.615075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.619969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.620478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.621124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.658268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:43.658750 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:43.659217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:43.659667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lazy-loading 'fault' on Instance uuid 49cbcd0c-7039-4918-a52c-75870c5b8000 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:43.708681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:43.718219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cd3544ff-7413-4d61-8475-8cb827fbeb5d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 200 len: 1331 microversion: 2.1 time: 0.116302 Sep 09 12:16:43.718790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 270/527] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:43 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:44.225216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:44.225736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:44.227718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:44.233769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.234246 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.234680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.235929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.236656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.237243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.384122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:44.391895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94ec69b7-e94a-4f3b-b86b-49ca8c930fc9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.170648 Sep 09 12:16:44.393324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 258/528] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:44 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:44.554305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:44.554928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:44.561233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.561712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.562146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.562825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.563298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.563835 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.694127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:44.703339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:44.705043 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:44.706208 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-83ee356c-15e8-4597-be2d-004debb3a0a3 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.155861 Sep 09 12:16:44.706783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 271/529] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:44 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:44.741740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:44.742277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:44.748547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.749243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.749801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.750737 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:44.751881 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:44.752410 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:44.769901 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 HTTP/1.1 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:16:44.771582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:16:44.773294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '49cbcd0c-7039-4918-a52c-75870c5b8000'} Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:44.774208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:16:44.775887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:16:44.777191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:44.777191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-be6b64b3-475a-44c7-8369-322efb4805aa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 404 len: 111 microversion: 2.1 time: 0.035220 Sep 09 12:16:44.777191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 259/530] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:44 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:44.781930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3574418c-f3cb-4f8d-8e17-cd227a860522 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '.version_select at 0x7f6bd0e24280>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:44.802005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3574418c-f3cb-4f8d-8e17-cd227a860522 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582071428" status: 202 len: 0 microversion: 2.1 time: 0.023868 Sep 09 12:16:44.802836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 272/531] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 9 12:16:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582071428 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:45.415468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:45.416086 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:45.422550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.423703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.424152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.424861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.425322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.425749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.481620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:45.482118 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:45.489090 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.489312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.489955 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.490649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.491144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.491934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.561816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:45.569955 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-61b5267f-23ef-40ba-818f-48a1f14a07cf tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.158217 Sep 09 12:16:45.570526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 260/532] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:45 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:45.616769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lazy-loading 'services' on Instance uuid df0cb5c6-89f6-4231-8311-7ddbe2693c70 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:45.733543 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:45.734163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:45.741167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.741367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-158f8969-a9fa-4e2d-88c2-8e9659cebfaa tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments/6677887c-7448-4ba7-abc1-77af6f4b3482" status: 202 len: 0 microversion: 2.1 time: 0.262856 Sep 09 12:16:45.741811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.742073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.742254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 273/533] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:16:45 2022] DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments/6677887c-7448-4ba7-abc1-77af6f4b3482 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:16:45.743127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.743751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.744179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.754351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:45.756238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:45.763453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.765428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.766341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.767157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:45.767612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:45.768054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:45.806159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4f3f66fb-4c59-4480-acc5-67e052592568 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058432 Sep 09 12:16:45.807218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 274/534] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:45 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:45.895591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:45.904090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:45.905540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:45.906693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-59c1155e-7228-4afd-8bec-4e9a585339bc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.177620 Sep 09 12:16:45.907640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 261/535] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:45 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:46.278573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "name": "network-vif-plugged", "status": "completed", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:46.289457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.290021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.290524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.302716 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] Creating event network-vif-plugged:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:16:46.318563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-16d92cfb-7686-4464-91c4-0970843efcba req-24da05bf-02a3-4901-972c-1e70d655a2fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Sep 09 12:16:46.319516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 275/536] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:46.593487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:46.594099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:46.601070 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.601565 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.601983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.602666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.603150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.603573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.741616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:46.752210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0eacb553-b3d0-4a33-adc9-689ee99eae62 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.162194 Sep 09 12:16:46.752806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 262/537] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:46 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:46.820379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:46.822641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:46.829189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.829788 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.830405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.831133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.831590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.832006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.862437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9647494f-1622-4301-8264-2907e8a4d7d5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046412 Sep 09 12:16:46.863093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 276/538] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:46 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:16:46.927817 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:46.928316 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:46.932312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:46.932921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:46.934740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.935265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.935706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.936401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.936857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.937312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.939831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.940385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.940892 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.941653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:46.942182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:46.942675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:46.962331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:16:46.987776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:47.039516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f904d209-dffa-4b55-bdc8-27b952e033a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 204 len: 0 microversion: 2.1 time: 0.116224 Sep 09 12:16:47.040107 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 263/539] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:46 2022] DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:16:47.048753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:47.049433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:47.055273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:47.055761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:47.056187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:47.057142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:47.057775 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:47.058201 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:47.085539 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:47.094205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:47.095927 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:47.097129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-42c3d82a-67bc-4712-b5be-381981c8d24a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.168875 Sep 09 12:16:47.097695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 277/540] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:46 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:16:47.197438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:47.205533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cd39141a-e012-4283-b657-2885326becfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1683 microversion: 2.1 time: 0.161091 Sep 09 12:16:47.206095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 264/541] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:47 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:47.775573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:47.776184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:47.782263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:47.782805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:47.783283 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:47.783976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:47.784427 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:47.784852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:47.803488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:47.920084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:47.928620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3065bdc6-6c32-41ec-8981-eaeace774815 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.156877 Sep 09 12:16:47.929191 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 278/542] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:47 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:48.124050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:48.124660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:48.131895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.132380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.132816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.133503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.133967 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.134394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.228807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:48.229423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:48.235435 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.235930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.236371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.237072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.237527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.237954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.262816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:48.272167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:48.273620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:48.274778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8b6c9308-a00a-45b4-ba5f-92e09f0ded78 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.154748 Sep 09 12:16:48.275370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 265/543] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:48 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:48.341793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "name": "network-vif-plugged", "status": "completed", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:48.351619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.352097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.352526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.365725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] Creating event network-vif-plugged:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:16:48.370961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-632f095a-3cc5-4ce6-9142-8acd6e77a2e1 req-c29962d5-daf2-4ea4-b0d5-d11219a778da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033011 Sep 09 12:16:48.371442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:48.371597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 266/544] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:16:48.379864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a3954065-fa8e-416b-beeb-81bcde57c556 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1683 microversion: 2.1 time: 0.154842 Sep 09 12:16:48.380426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 279/545] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:48 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:48.952679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:48.953765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:48.959963 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.960505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.961048 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:48.961744 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:48.962201 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:48.962658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:49.102478 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:49.110317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2597552e-57ff-426f-b20b-a3e9fe7fa222 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.161727 Sep 09 12:16:49.111424 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 267/546] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:48 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:49.300703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:49.301308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:49.307823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:49.308308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:49.308744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:49.309515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:49.309970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:49.310396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:49.407811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:49.408795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:49.414876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:49.415378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:49.415992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:49.416684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:49.417131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:49.417891 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:49.455704 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:49.465051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:49.466764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:49.468698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f9fa5638-99be-43d6-881d-6160fd984912 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1809 microversion: 2.20 time: 0.172082 Sep 09 12:16:49.471490 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 280/547] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:49 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:49.576145 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:49.584480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7db9dfc6-5e69-4e22-82cd-b63db117553b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1683 microversion: 2.1 time: 0.184549 Sep 09 12:16:49.585062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 268/548] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:49 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:50.133310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:50.133919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:50.139902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.140387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.140825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.142047 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.142614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.143264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.286183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:50.295062 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b581df3d-2cce-4ee4-ae98-371c629fd64e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1358 microversion: 2.1 time: 0.165495 Sep 09 12:16:50.300813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 281/549] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:50 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:50.497396 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:50.498045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:50.505433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.506136 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.506583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.507354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.507809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.508236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.607810 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:50.608463 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:50.614659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.615185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.615716 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.616424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.616883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.617309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:50.655756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:50.666326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:50.667921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:50.669347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9a807db0-ca54-48ce-973d-eb133abdea4d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1796 microversion: 2.20 time: 0.176776 Sep 09 12:16:50.669914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 269/550] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:50 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1796 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:50.689439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:50.700986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-66a504ab-4b33-4b06-9150-914acd0c52a5 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1615 microversion: 2.1 time: 0.096956 Sep 09 12:16:50.701575 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 282/551] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:50 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:50.982023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0cb5c6-89f6-4231-8311-7ddbe2693c70", "name": "network-vif-deleted", "tag": "87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:50.992387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:50.993120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:50.993896 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.006961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] Creating event network-vif-deleted:87469ae6-cb6c-4bdf-bee1-0ff3113b8a6d for instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 on hv-cinder-85221 Sep 09 12:16:51.011945 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-f58c44dc-604c-44df-a239-b6cb862f50d7 req-180f5b27-9aba-4f46-bb35-b8a701fbbdfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033835 Sep 09 12:16:51.015686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 270/552] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:51.318645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:51.319273 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:51.325288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.325769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.326206 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.326887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.327362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.327776 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.480313 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:51.490504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ad5fcac6-0323-4568-b630-6022ef528caa tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1548 microversion: 2.1 time: 0.176149 Sep 09 12:16:51.491284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 283/553] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:51 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:51.513534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:51.514256 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:51.521632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.522113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.522600 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.523252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.523706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.524129 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.679322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:51.686183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1f1db7c4-2fbe-4f6a-8563-1fa87ed468e0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1548 microversion: 2.1 time: 0.176753 Sep 09 12:16:51.686964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 271/554] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:51 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:51.709129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:51.714006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:51.714667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Searching by: {'deleted': False, 'project_id': 'baec172d59054da499387e85a4b8727e'} {{(pid=120591) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 12:16:51.722410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.722874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.723330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.724052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.724498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.724918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.725048 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:51.725629 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:51.731663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.732077 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.732509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.733207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.733659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.734083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.765694 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.767143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.767840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.768450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lazy-loading 'fault' on Instance uuid df0cb5c6-89f6-4231-8311-7ddbe2693c70 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:51.817787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:51.824159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.multi_cell_list [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120591) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 12:16:51.827232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-23024670-23fc-472e-a8a7-422943ea8a94 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 200 len: 1332 microversion: 2.1 time: 0.105692 Sep 09 12:16:51.827929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 272/555] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:51 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:51.921815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-61139a14-1273-4ce6-93eb-f96a09a3e42f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216387 Sep 09 12:16:51.927044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 284/556] 10.222.0.49 () {58 vars in 1125 bytes} [Fri Sep 9 12:16:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:51.928586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e96f72dd-70b6-4405-a955-a60522f17e95"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:51.930987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:51.935547 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:51.936286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:51.937393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.937895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.938345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.939115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.939573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.940177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.943002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.943599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.944151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:51.945114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:51.945654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:51.946082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:52.103249 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:52.119201 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b4dc4b9a-7982-40b9-bde8-f85fc505753e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1548 microversion: 2.1 time: 0.188554 Sep 09 12:16:52.120122 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 285/557] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:51 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:52.226881 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cce32a9a-82dd-40c4-a3f4-0b70b66b8d25 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302262 Sep 09 12:16:52.227695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 273/558] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:16:51 2022] POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:52.850542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:52.851184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:52.857274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:52.857842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:52.858281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:52.858999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:52.859456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:52.859878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:52.872967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 HTTP/1.1 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:16:52.874598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:16:52.876603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'df0cb5c6-89f6-4231-8311-7ddbe2693c70'} Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:52.877360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:16:52.878755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:16:52.880048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:52.880048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c2439797-a41a-48ed-9c6d-4d1c9b3d2fd1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 404 len: 111 microversion: 2.1 time: 0.029877 Sep 09 12:16:52.880048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 286/559] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:52 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:52.886549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d73808af-912b-46c5-8706-edd112ffae3e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '.version_select at 0x7f6bd0ce65e0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:52.906991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d73808af-912b-46c5-8706-edd112ffae3e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844566760" status: 202 len: 0 microversion: 2.1 time: 0.024848 Sep 09 12:16:52.907477 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 274/560] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 9 12:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844566760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:53.541102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-44207f2a-c3c8-4fac-b3f5-c81256a092cc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: .version_select at 0x7f6bd0cdd790>, body: {"keypair": {"name": "tempest-keypair-1741864294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQZ+vgk1nLd/oQryO8LtxVmrb62vFffxzv4Qg99dVBhg6vGzD5Ohuy+3FWQjfadLTQL/1rJhxEteOVw9BkeiVWlY118jre1qM1GND/P5BKBS7xFkWSzUG/7OtfhLJpBRA=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:53.546361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:53.559979 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-44207f2a-c3c8-4fac-b3f5-c81256a092cc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:16:53.564031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-44207f2a-c3c8-4fac-b3f5-c81256a092cc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:16:53.586379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-44207f2a-c3c8-4fac-b3f5-c81256a092cc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048993 Sep 09 12:16:53.586998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 287/561] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:16:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:53.696902 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a97a70a8-47c6-4102-b0a1-38b630710a71"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:53.699446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:53.706610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.707132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.707582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.708283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.708738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.709168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.975510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fe677200-8fe8-462d-9c4a-c12caf4d4f2d tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282832 Sep 09 12:16:53.976602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 275/562] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:16:53 2022] POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:55.039517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1234039991", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2"}], "security_groups": [{"name": "tempest-securitygroup--887083462"}], "key_name": "tempest-keypair-1741864294", "user_data": "}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:55.157627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] validate_networks() for [('8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:16:55.549812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:16:55.550242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:16:55.550755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:16:55.551199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:16:55.551615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:16:55.560419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:55.560902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:55.561338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:55.562068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:55.562522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:55.563518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:55.579945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:16:55.583885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:16:55.594844 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:16:55.597156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:16:55.644297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c2977fc3-1a95-4d24-979f-040035e029e0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609097 Sep 09 12:16:55.645147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 288/563] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:16:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:16:55.657723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cad0c27b-23af-4389-b883-f161e9003238 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:55.658443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cad0c27b-23af-4389-b883-f161e9003238 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:55.713463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cad0c27b-23af-4389-b883-f161e9003238 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:55.721436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cad0c27b-23af-4389-b883-f161e9003238 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1242 microversion: 2.1 time: 0.068972 Sep 09 12:16:55.722367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 276/564] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:55 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:56.745760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:56.746452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:56.754341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:56.754920 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:56.755378 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:56.756100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:56.756550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:56.756992 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:56.828097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:56.837350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b6b6d527-7a46-4a6e-b13d-c0a2a5927e79 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1302 microversion: 2.1 time: 0.095814 Sep 09 12:16:56.838221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 289/565] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:56 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:57.862407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:57.863065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:57.869924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:57.870401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:57.871086 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:57.871777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:57.872249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:57.872659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:58.008847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:58.017009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-68b2363d-838b-49d6-a129-c8f0a6b04974 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.159018 Sep 09 12:16:58.017660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 277/566] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:57 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:58.179544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de381707-963b-4b31-824d-2dc1e3481dc5", "tag": "0a30b602-86bb-470c-afd6-a8e3923e8724"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:58.189739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:58.190223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:58.190657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:58.201388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] Creating event network-changed:0a30b602-86bb-470c-afd6-a8e3923e8724 for instance de381707-963b-4b31-824d-2dc1e3481dc5 on hv-cinder-85221 Sep 09 12:16:58.206439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b505df53-03d1-403a-b34a-bee05af62cf3 req-2b309c99-223d-4479-8317-9f657dad5816 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030674 Sep 09 12:16:58.207066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 290/567] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:59.042460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:59.043100 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:59.051394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.051811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.052245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.053450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.053956 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.054381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.209372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:59.218571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c39fa31c-536f-41cb-a829-1dc96e6e7093 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.181178 Sep 09 12:16:59.219607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 278/568] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:59 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:59.790787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:59.793158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:59.800009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.800500 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.800942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.801641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.802099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.802524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.825298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'flavor' on Instance uuid 31d8fc89-81a5-497c-b068-cc32e6905cea {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:59.946787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b5c2eff3-ef94-453f-8309-5efb92cbff49 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/action" status: 200 len: 32 microversion: 2.1 time: 0.160187 Sep 09 12:16:59.947345 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 291/569] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:16:59 2022] POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:16:59.956853 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:59.957498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:59.964063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.964549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.964986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.965682 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.966137 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.966562 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:00.099314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:00.101605 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:00.108894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-acba7106-7227-4dfe-baca-e9c39a373363 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.155880 Sep 09 12:17:00.110166 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 279/570] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:59 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:00.242966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:00.243584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:00.249648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:00.250130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:00.250568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:00.251478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:00.251934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:00.252357 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:00.394787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:00.403245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dbce5b3b-02c7-4b76-a74b-2b49fdbcb02f tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.164427 Sep 09 12:17:00.404060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 292/571] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:00 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:01.132575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:01.133190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:01.140783 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.141278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.141708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.142400 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.142851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.143312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.290048 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:01.298261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1fa33895-1372-4a3b-89a5-d419c4bd69eb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.169645 Sep 09 12:17:01.298831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 280/572] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:01 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:01.426146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:01.427061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:01.433233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.433709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.434138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.434813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.435285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.435702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.569604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:01.577280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ae7ddd4-44ed-482d-9c37-27f973bedc59 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.155284 Sep 09 12:17:01.577812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 293/573] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:01 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:02.321587 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:02.322190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:02.329409 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:02.329890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:02.330322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:02.331034 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:02.331486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:02.331904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:02.462854 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:02.471408 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1b1dd7d6-7076-44c7-a8bb-99d86c4dbb83 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.153642 Sep 09 12:17:02.471976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 281/574] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:02 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:02.600609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:02.601168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:02.607060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:02.607550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:02.607997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:02.608688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:02.609144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:02.609622 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:02.744260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:02.752643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bd6cef9a-ac21-4ed0-b660-2b397454f19b tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.155960 Sep 09 12:17:02.753197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 294/575] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:02 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:03.494649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:03.495264 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:03.501823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.502304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.502829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.503541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.503994 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.504416 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.637168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:03.646139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8963a320-c5d8-4c8c-b673-861d90280641 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.155279 Sep 09 12:17:03.646707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 282/576] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:03 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:03.776107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:03.776752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:03.783521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.784007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.784443 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.785135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.785589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.786010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.915388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:03.919011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:03.923951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1f88dd63-461e-4ed6-aa58-e6212682c2a9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.151689 Sep 09 12:17:03.924531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 295/577] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:03 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:04.034107 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de381707-963b-4b31-824d-2dc1e3481dc5", "name": "network-vif-plugged", "status": "completed", "tag": "0a30b602-86bb-470c-afd6-a8e3923e8724"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:04.043710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.044187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.044619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.056326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] Creating event network-vif-plugged:0a30b602-86bb-470c-afd6-a8e3923e8724 for instance de381707-963b-4b31-824d-2dc1e3481dc5 on hv-cinder-85221 Sep 09 12:17:04.061199 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e4a54bd3-911e-4568-b6e7-72441295c218 req-9359d32d-eec2-4628-bb99-e512a79bae8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Sep 09 12:17:04.062009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 283/578] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:04.669890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:04.670505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:04.678565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.679077 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.679522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.680194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.680642 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.681318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.820566 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:04.829105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-68c465fa-185d-4fc5-a451-b7b0ddaaa626 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.163083 Sep 09 12:17:04.829670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 296/579] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:04 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:04.948435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:04.949140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:04.955623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.956141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.956571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.957257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.957708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.958130 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:05.089451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:05.097987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd35a98a-a3f3-4791-a9d7-80ed435209be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.154210 Sep 09 12:17:05.098522 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 284/580] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:04 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:05.853384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:05.854103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:05.856004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:05.856693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=10 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:05.861774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:05.862242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.862412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:05.862740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.863228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:05.863937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.864393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:05.864523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.864819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:05.869502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.869989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.870491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:05.871212 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.871663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.872085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:06.063036 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:06.066852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:06.071481 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1441899b-a3c0-4ce2-83b0-ae0ff034a042 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.221842 Sep 09 12:17:06.072074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 297/581] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:05 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:06.075496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bf8d5227-193a-42ad-9dd2-c1785ff7ba36 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1594 microversion: 2.1 time: 0.217874 Sep 09 12:17:06.076057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 285/582] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:05 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1594 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:06.120340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:06.120960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:06.127633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:06.128124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:06.128559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:06.129250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:06.129703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:06.130131 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:06.292863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:06.300915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bd3baf51-5c52-43ab-902a-af52ae778a8a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1367 microversion: 2.1 time: 0.184279 Sep 09 12:17:06.301618 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 298/583] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:06 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:07.096901 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:07.097577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:07.105032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.105620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.106062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.106794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.107255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.107679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.325158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:07.325818 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:07.325996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:07.332732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.333234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.333671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.334372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.334828 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.335281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.335378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-04441393-1760-400c-b4d7-a01143879c36 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.243376 Sep 09 12:17:07.342188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 286/584] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:07 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:07.817082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:07.824800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8c25f4e8-7469-4a72-aa1b-02ac8403bed0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1556 microversion: 2.1 time: 0.503622 Sep 09 12:17:07.825362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 299/585] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:07 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1556 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:07.847741 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:07.848238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:07.854234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.854716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.855366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.856058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.856516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.856941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.981685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-338b27d2-a556-4fe1-9953-34c740fa3423 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138355 Sep 09 12:17:07.982291 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 287/586] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:17:07 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:08.176813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:08.188784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:08.189603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:08.190414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:08.206216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] Creating event network-changed:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:17:08.212070 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-eb2e6ae9-8ef1-4db4-a971-0405c162f84a req-a71b8f09-cd3a-4e75-adc6-5695b2bbed89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038806 Sep 09 12:17:08.213012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 300/587] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:17:08.362773 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:08.370459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:08.379735 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:08.380484 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:08.380941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:08.381719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:08.382183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:08.382610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:08.647208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:08.663765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-91ccb2ad-f757-4770-a81a-016820890b7e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.306076 Sep 09 12:17:08.665653 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 288/588] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:08 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:09.381242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1623658475"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:09.382547 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:09.389250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.389740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.390575 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.391319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.391784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.392214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.533819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.network.security_group_api [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Adding security group c1e8fa1f-26a7-4269-8103-8f0f672c915d to port 9fd3a315-1c50-422b-b9e6-55e11c2d09ac Sep 09 12:17:09.690218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:09.691563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:09.699938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.700703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.701139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.702031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.703023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.703777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.942686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:09.951320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0770c04c-83ae-41cb-bd35-2abae7fe8073 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.266507 Sep 09 12:17:09.962924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 289/589] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:09 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:09.962924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de381707-963b-4b31-824d-2dc1e3481dc5", "tag": "0a30b602-86bb-470c-afd6-a8e3923e8724"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:09.970073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.970073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.970073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.981289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] Creating event network-changed:0a30b602-86bb-470c-afd6-a8e3923e8724 for instance de381707-963b-4b31-824d-2dc1e3481dc5 on hv-cinder-85221 Sep 09 12:17:09.986269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-7d08f63b-a383-4e72-a7dc-0eb1f3ac526b req-e0600d55-cca6-4b47-9560-5064ed1b4c1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032129 Sep 09 12:17:09.987192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 290/590] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:10.025849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d952b512-51dd-4dc4-993b-e944ee20ce3b tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action" status: 202 len: 0 microversion: 2.1 time: 0.648849 Sep 09 12:17:10.026865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 301/591] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:17:09 2022] POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:17:10.035879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:10.036736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:10.043510 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.044056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.044593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.045626 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.046302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.047009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.234067 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:10.240005 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:10.252238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7591c2fa-6a1b-4518-9267-8b0b48c36c25 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1759 microversion: 2.1 time: 0.220584 Sep 09 12:17:10.254535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.255247 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.255913 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.273753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] Creating event network-changed:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:17:10.275068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 291/592] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:10 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1759 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:10.281078 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-229a29ae-99f0-407c-af72-34e068ec6e8a req-9ba8212e-7b9c-4cf6-9625-b80708c2eb81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051063 Sep 09 12:17:10.281723 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 302/593] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:10.977396 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:10.978313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:10.985868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.986638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.987274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.988026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.988489 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.988916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:11.146710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:11.156350 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6dc8020e-8139-4f30-9d93-3c47ff406beb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.182191 Sep 09 12:17:11.156950 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 292/594] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:10 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:12.180171 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:12.181293 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:12.188639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:12.189117 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:12.189551 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:12.190233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:12.190680 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:12.191128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:12.321538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:12.331744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c392806a-9c4f-49c1-b358-02f7cf36f48c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.155914 Sep 09 12:17:12.332358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 303/595] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:12 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:13.355062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:13.355798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:13.363040 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:13.363536 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:13.363984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:13.364684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:13.365141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:13.365568 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:13.494606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:13.502800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-151e46ab-7f3e-4375-ba6c-382bb21c3dff tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.151683 Sep 09 12:17:13.503387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 293/596] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:13 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:14.527221 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:14.527836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:14.534075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:14.534564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:14.535033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:14.535726 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:14.536181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:14.536606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:14.671560 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:14.681708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-08f8f2bd-4ea9-4a8e-b724-dfe3bc938793 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.158325 Sep 09 12:17:14.682292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 304/597] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:14 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:15.706056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:15.706693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:15.709192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:15.714818 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:15.715348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:15.715790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:15.716497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:15.716955 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:15.717399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:15.849414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:15.857588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c6c2a54e-0c22-42a4-b286-b65c92ce1d52 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.155859 Sep 09 12:17:15.858609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 294/598] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:15 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:16.880663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:16.881277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:16.887430 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:16.887913 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:16.888350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:16.889033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:16.889488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:16.889948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:17.019410 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:17.027648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bb674195-8aaa-4909-9703-edf4640c34bc tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.150902 Sep 09 12:17:17.028232 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 305/599] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:16 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:18.052154 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:18.052773 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:18.059606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:18.060090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:18.060521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:18.061205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:18.061662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:18.062248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:18.196868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:18.205748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-45cb954c-0a36-4a1e-a915-974488603da5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1737 microversion: 2.1 time: 0.157409 Sep 09 12:17:18.206317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 295/600] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:18 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:19.229445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:19.230415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:19.240861 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.241382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.241877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.242639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.243347 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.243962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.378518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:19.386768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d6cf2bbd-60c3-420b-85cc-cb36e97baf9b tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1717 microversion: 2.1 time: 0.161186 Sep 09 12:17:19.387372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 306/601] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:19 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:19.498006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:19.498499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:19.505112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.505596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.506032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.506719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.507217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.507644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.634290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] HTTP exception thrown: Cannot 'detach_volume' instance 31d8fc89-81a5-497c-b068-cc32e6905cea while it is in vm_state rescued Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Request method failure captured: Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments/e96f72dd-70b6-4405-a955-a60522f17e95 HTTP/1.1 Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3CnrLCJ6oOehmzbF8gFtuup_oiv1UdC2bs9O30p4ZpA3TgQ5RMWadleaQS7PixloHYcu9pAiQlgaLuEi7VfXswozZyukkpxsO6tDqfkjsYGQJX88xBaRJ89J0hdXS1j2ByLNqpn3Rd7k1KE3KSDaq-eaeUfDpqXzt7DefLkWXADPw Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:17:19.635929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 31411178e5c342b7bb14a21dec62f540 Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:17:19.637526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Cannot 'detach_volume' instance 31d8fc89-81a5-497c-b068-cc32e6905cea while it is in vm_state rescued Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'server_id': '31d8fc89-81a5-497c-b068-cc32e6905cea', 'id': 'e96f72dd-70b6-4405-a955-a60522f17e95'} Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:19.638269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 31d8fc89-81a5-497c-b068-cc32e6905cea while it is in vm_state rescued Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 31d8fc89-81a5-497c-b068-cc32e6905cea while it is in vm_state rescued Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:19.640279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Returning 409 to user: Cannot 'detach_volume' instance 31d8fc89-81a5-497c-b068-cc32e6905cea while it is in vm_state rescued {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:19.641379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-56047f36-ef48-4e4f-a709-50f66e27ed9d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments/e96f72dd-70b6-4405-a955-a60522f17e95" status: 409 len: 152 microversion: 2.1 time: 0.143388 Sep 09 12:17:19.641379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 296/602] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:17:19 2022] DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments/e96f72dd-70b6-4405-a955-a60522f17e95 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 12:17:19.647647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:19.647775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:19.653788 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.654277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.654719 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.655495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.655952 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.656378 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.722460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-85375efc-8a23-456e-b4f4-65ae52accbce tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/action" status: 202 len: 0 microversion: 2.1 time: 0.078969 Sep 09 12:17:19.723143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 307/603] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:17:19 2022] POST /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:17:19.735654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:19.736917 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:19.743560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.744102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.744621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.745407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:19.745952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:19.746941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:19.883442 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:19.892516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1e855c65-613a-4338-8624-1a4c7d9cb469 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1725 microversion: 2.1 time: 0.164894 Sep 09 12:17:19.893179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 297/604] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:19 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:20.916617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:20.917313 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:20.923555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:20.924040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:20.924474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:20.925160 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:20.925612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:20.926036 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:21.059870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:21.068205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-de9e6504-c4b1-4956-859e-e31d9279a2d3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1725 microversion: 2.1 time: 0.155798 Sep 09 12:17:21.068760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 308/605] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:20 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:22.092930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:22.094045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:22.101226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:22.101689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:22.102118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:22.102796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:22.103320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:22.103742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:22.106383 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:22.240793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:22.249666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dcaf7756-b17b-4462-8b48-d4b1d201e9c1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1725 microversion: 2.1 time: 0.161381 Sep 09 12:17:22.250232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 298/606] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:22 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:23.273684 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:23.274299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:23.280277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:23.280870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:23.281311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:23.281998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:23.282456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:23.282880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:23.408971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:23.417100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a31c47d0-8dff-4fc4-9f53-4c54c6840920 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1731 microversion: 2.1 time: 0.147457 Sep 09 12:17:23.417667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 309/607] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:23 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:23.440821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:23.441315 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:23.447742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:23.448218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:23.448649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:23.449322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:23.449767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:23.450183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:23.525447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6d315f7a-50f0-4eb3-9b8e-bf08c10b11bb tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088366 Sep 09 12:17:23.525974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 299/608] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:17:23 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:24.423894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:24.429596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:24.436907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:24.437542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:24.437983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:24.450076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] Creating event network-changed:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:17:24.455389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-ac3c7428-ad06-4632-9e24-c45a4cb96c03 req-3198b8c0-5b0e-418b-9e09-9cc3f217e5c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035502 Sep 09 12:17:24.455984 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 310/609] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:26.470364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:26.480147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:26.480615 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:26.481039 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:26.492739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] Creating event network-changed:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:17:26.497692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-336b9111-6d52-4db4-bb6c-3a50498ba0ae req-831625d8-5c03-4dd7-a332-2b3f43274b06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Sep 09 12:17:26.498317 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 300/610] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:32.505264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:32.506015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:32.512304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.512791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.513223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.514476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.514953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.515387 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.544148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-26485ccd-9058-44bd-ae97-fd78e82100a4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments/7fd5a093-2de8-4b14-81e4-272fcc6c7651" status: 200 len: 194 microversion: 2.20 time: 0.043629 Sep 09 12:17:32.544730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 311/611] 10.222.0.49 () {60 vars in 1454 bytes} [Fri Sep 9 12:17:32 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments/7fd5a093-2de8-4b14-81e4-272fcc6c7651 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:17:32.615102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:32.615681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:32.621801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.622281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.622714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.623984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.624446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.624884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.660163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:32.662744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:32.668682 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.669156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.669585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.670365 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.670825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.671379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.706079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lazy-loading 'services' on Instance uuid 578576a5-5165-4c3b-b095-1ca6461b2610 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:17:32.750099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:32.761865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b4c5b5ca-1786-485e-b378-0376e0e0c4c9 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action" status: 202 len: 0 microversion: 2.1 time: 0.106131 Sep 09 12:17:32.766967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 312/612] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:17:32 2022] POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:17:32.772970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:32.773178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:32.781413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.781756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.782186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.782941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.783529 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.783971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.853080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b101736e-3e0a-487d-a83b-e7e867975cbf tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments/7fd5a093-2de8-4b14-81e4-272fcc6c7651" status: 202 len: 0 microversion: 2.20 time: 0.242869 Sep 09 12:17:32.856923 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 301/613] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Sep 9 12:17:32 2022] DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments/7fd5a093-2de8-4b14-81e4-272fcc6c7651 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:17:32.864058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:32.867401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:32.876607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.878007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.878464 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.879222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:32.879705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:32.880289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.938993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2a5889cf-b290-4f1f-a35b-3fabf42383b8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079653 Sep 09 12:17:32.940810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 302/614] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 9 12:17:32 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:17:32.953693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:32.962250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-da2241a5-86ff-4882-b221-31b2e7018770 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1751 microversion: 2.1 time: 0.193881 Sep 09 12:17:32.962819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 313/615] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:32 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:33.952884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:33.955017 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:33.961394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.961877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.962305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:33.963010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.963462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.963886 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:33.987216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:33.987761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:33.993711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.993969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c6877a7d-e2b9-42b8-a33d-7f7728245252 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045140 Sep 09 12:17:33.994200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.994471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 303/616] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 9 12:17:33 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:33.994642 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:33.995363 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.995816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.996239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.060120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:34.060654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:34.066772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.067302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.067739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.068438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.068888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.069308 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.095267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:17:34.144597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:34.152987 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a007265-f403-4ebd-ac2b-4eb609057ee5 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.170448 Sep 09 12:17:34.153563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 314/617] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:33 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:34.186329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-364d0060-3d5a-42f5-a96a-4e2c5e937a5c tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 204 len: 0 microversion: 2.20 time: 0.129411 Sep 09 12:17:34.186977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 304/618] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 9 12:17:34 2022] DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 12:17:34.195065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:34.195680 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:34.201901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.202388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.202830 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.203552 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.204010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.204437 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.335938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:34.345067 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:34.346816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:34.348292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0c61c128-83c3-4923-97dd-724b5ee39228 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.157089 Sep 09 12:17:34.349074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 315/619] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:34 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:17:35.178271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:35.179023 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:35.186466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.186972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.187406 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.188104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.188557 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.188977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.335131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:35.343375 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-972e14ed-980a-42ff-9e85-66025fb54364 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.169280 Sep 09 12:17:35.343876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 305/620] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:35 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:35.374238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:35.374866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:35.380728 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.381212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.381641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.382318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.382767 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.383212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.519787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:35.527763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:35.529730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:35.531302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0006c9cf-06ec-4ca0-85f0-721f97537dc9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1724 microversion: 2.20 time: 0.161679 Sep 09 12:17:35.531858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 316/621] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:35 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:36.367527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:36.368095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:36.375420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.375909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.376343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.377055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.377508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.377932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.525686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:36.536185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ffc370da-66a3-4ab6-9e57-ff1dca820b57 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.172654 Sep 09 12:17:36.550925 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 306/622] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:36 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:36.557822 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:36.558631 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:36.565588 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.566494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.566494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.567273 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.567729 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.568139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.633558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:36.644024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:36.645495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:36.646660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e471732a-4d03-4db2-abca-ab9de56c50a9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 200 len: 1656 microversion: 2.20 time: 0.093054 Sep 09 12:17:36.647241 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 317/623] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:36 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:36.848265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578576a5-5165-4c3b-b095-1ca6461b2610", "name": "network-vif-deleted", "tag": "bcd71e01-67e0-4b21-8884-e57c89a88742"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:36.858190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.858707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.859331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.876123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] Creating event network-vif-deleted:bcd71e01-67e0-4b21-8884-e57c89a88742 for instance 578576a5-5165-4c3b-b095-1ca6461b2610 on hv-cinder-85221 Sep 09 12:17:36.882006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-a3e44732-8826-4c0f-863d-bb22f2f8cb73 req-27ae8164-b395-428e-b99d-3104b4922037 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Sep 09 12:17:36.883037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 307/624] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:37.561593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:37.562209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:37.568278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.568760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.569192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.569876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.570323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.570741 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.673115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:37.674538 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:37.681378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.682082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.682599 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.683362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.683829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.684265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.700581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 HTTP/1.1 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:17:37.702977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:17:37.704314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '578576a5-5165-4c3b-b095-1ca6461b2610'} Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:37.705089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:17:37.706258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:17:37.707378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:37.707378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-55de3cce-0dc4-45e2-9005-0ae6824f1a24 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 404 len: 111 microversion: 2.20 time: 0.036589 Sep 09 12:17:37.707378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 308/625] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:37 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 12:17:37.713965 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-967051b0-92dc-4ba7-8adf-c51b5b32c6b9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '.version_select at 0x7f6bd0ce6c10>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:37.737838 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-967051b0-92dc-4ba7-8adf-c51b5b32c6b9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605139091" status: 204 len: 0 microversion: 2.20 time: 0.027728 Sep 09 12:17:37.739261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 309/626] 10.222.0.49 () {60 vars in 1262 bytes} [Fri Sep 9 12:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605139091 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 12:17:37.939446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:37.947739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-62ba618d-1a43-41de-8557-4466fe3083b6 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.390410 Sep 09 12:17:37.948239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 318/627] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:37 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:38.394301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6b5c25ba-df1a-4bd1-8781-6906ae156edc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: .version_select at 0x7f6bd0bd1550>, body: {"keypair": {"name": "tempest-keypair-1094560161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICZbjXCKDDssKG3h975mCeQ/Gc1LyiB7Z0jKgt8r9MQLY6crrBX+18sS3V2WETooDisZLNY8GT1VJjwvvyFm48KH2bjluBGxl3kXR2s66dLfifDLN+0nrx25hS7AGt9lA=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:38.410993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6b5c25ba-df1a-4bd1-8781-6906ae156edc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for project f2f72b6ae8d3482e935d3375bc999732. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:17:38.414732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6b5c25ba-df1a-4bd1-8781-6906ae156edc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for user b9a5c9fb3f664ae097f0c3ce6f6c0764 and project f2f72b6ae8d3482e935d3375bc999732. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:17:38.437598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6b5c25ba-df1a-4bd1-8781-6906ae156edc tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047171 Sep 09 12:17:38.438191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 310/628] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Sep 9 12:17:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 12:17:38.972705 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:38.973335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:38.979189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:38.979679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:38.980114 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:38.980808 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:38.981261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:38.981684 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:39.212306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:39.220750 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f624433c-8d95-4f8c-9465-1cf5caae8ebe tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.251909 Sep 09 12:17:39.221545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 319/629] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:38 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:39.721279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1139248013", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ee3e7ed-1f23-4a3e-baef-1657fb65ad87"}], "security_groups": [{"name": "tempest-securitygroup--1360753793"}], "key_name": "tempest-keypair-1094560161", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:39.827924 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] validate_networks() for [('9ee3e7ed-1f23-4a3e-baef-1657fb65ad87', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:17:40.199613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:17:40.200046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:17:40.200519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:17:40.201176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:17:40.201591 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:17:40.210273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.210753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.211228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.211953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.212405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.212828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.229685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for project f2f72b6ae8d3482e935d3375bc999732. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:17:40.234338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Getting quotas for user b9a5c9fb3f664ae097f0c3ce6f6c0764 and project f2f72b6ae8d3482e935d3375bc999732. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:17:40.244429 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:40.245063 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:40.245905 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:17:40.248290 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:17:40.251026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.251506 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.251933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.252611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.253055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.253466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.296073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d757433e-ee16-4ea5-844d-d5c5d98cc9b0 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.580285 Sep 09 12:17:40.297102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 311/630] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Sep 9 12:17:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 12:17:40.308182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:40.308820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:40.373684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:40.381444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:40.383046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:40.384266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2c2195d3-ed81-4f71-9006-e7778d02e4b2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1282 microversion: 2.20 time: 0.080350 Sep 09 12:17:40.385302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 312/631] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:40 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:17:40.436860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:40.445278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a8ebf020-af40-4c6e-882d-0a31221b20af tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.204782 Sep 09 12:17:40.445845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 320/632] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:40 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:41.409976 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:41.410516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:41.416959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.417441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.417873 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.418578 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.419037 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.419461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.469309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:41.470008 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:41.476167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.476652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.477086 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.477781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.478234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.478661 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.486418 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:41.494669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:41.496165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:41.497272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2c27ffc8-eb83-4747-8981-682a92a10f1b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1334 microversion: 2.20 time: 0.091350 Sep 09 12:17:41.498703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 313/633] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:41 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:17:41.644005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:41.657189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-58fcfb9d-e6a7-4711-b825-ccf4b18591b0 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.192021 Sep 09 12:17:41.657815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 321/634] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:41 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:42.525490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:42.526278 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:42.532931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.533498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.534010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.534713 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.535188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.535692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.670722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:42.679724 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:42.681437 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:42.681627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:42.682553 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c6b45b66-b1cb-460e-8616-877383198033 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.161721 Sep 09 12:17:42.682845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:42.683129 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 314/635] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:42 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:42.690320 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.691115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.691553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.692428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.692883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.693463 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.939396 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:42.952069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.952836 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.953441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.962667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:42.965437 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] Creating event network-changed:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:17:42.970786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-eb2c8b18-62d1-44ce-9613-0cd138125d03 req-f704c4cd-b9c4-4f2c-b3ce-8e9b8982e67d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Sep 09 12:17:42.971439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 315/636] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:42.972636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-93911c49-2a9e-4170-aedb-b3248335e754 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.295255 Sep 09 12:17:42.973384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 322/637] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:42 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:43.710417 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:43.711128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:43.717621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:43.718092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:43.718518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:43.719230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:43.719684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:43.720102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:43.900265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:43.908681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:43.910117 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:43.911239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c0e24736-0bfc-41ec-9fb3-6cb4e879ed43 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.205507 Sep 09 12:17:43.911796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 316/638] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:43 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:43.996713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:43.997829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:44.004742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.005217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.005646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:44.006322 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.006771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.007227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:44.150246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:44.159019 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-16e13d1d-fe32-44eb-b374-bb15b70cabcb tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.166146 Sep 09 12:17:44.159585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 323/639] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:43 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:44.945437 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:44.946302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:44.953371 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.953850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.954281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:44.954988 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.955436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.955854 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:45.096969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:45.105130 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:45.106572 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:45.107851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-760f6481-2419-44ca-be71-0ccc4e776089 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.166402 Sep 09 12:17:45.108467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 317/640] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:44 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:45.182985 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:45.183746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:45.190267 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:45.190754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:45.191223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:45.191917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:45.192376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:45.192803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:45.334648 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:45.343424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3eeafc6c-cfb9-4505-987b-6dd4451502e2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.164617 Sep 09 12:17:45.343989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 324/641] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:45 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:46.133203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:46.133819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:46.136287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:46.141632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.142120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.142559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.143282 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.143738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.144161 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.285140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:46.293180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:46.294990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:46.296132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7f99d4b6-c371-4926-a1b2-c10f3a386676 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.166864 Sep 09 12:17:46.296798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 318/642] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:46 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:46.366600 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:46.367228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:46.373358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.373840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.374269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.374967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.375416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.375834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.520123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:46.530430 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e160a94-7ba1-408f-89f2-3975fe9b1c9e tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.167679 Sep 09 12:17:46.531015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 325/643] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:46 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:47.320717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:47.321346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:47.328235 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.328711 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.329140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.329821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.330265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.330684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.334506 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:47.466423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:47.474893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:47.476414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:47.477514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8cccd384-c6c7-4ebd-b33e-ca43c26708e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.160681 Sep 09 12:17:47.478072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 319/644] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:47 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:47.553157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:47.553778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:47.560734 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.561169 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.561699 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.562453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.562948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.563388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.706383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:47.714604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e174316a-579f-44e1-901c-2c5c66272183 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.165279 Sep 09 12:17:47.715196 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 326/645] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:47 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:48.253695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "name": "network-vif-plugged", "status": "completed", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:48.264279 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.264956 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.265389 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.277196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] Creating event network-vif-plugged:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:17:48.282731 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-1b39fced-71da-4e4c-ab6f-8dfabaab4c9c req-095a4bf3-4331-4933-b250-9d50bb7eb00a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032759 Sep 09 12:17:48.283367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 320/646] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:17:48.502477 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:48.503120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:48.509142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.509630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.510068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.510769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.511271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.511696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.643193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:48.651441 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:48.652881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:48.654973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-41aec77c-b92e-4520-9685-7d1e822ca443 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.156358 Sep 09 12:17:48.655529 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 327/647] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:48 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:17:48.738497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:48.739219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:48.745306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.745783 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.746214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.746911 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.747684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.748268 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.894588 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:48.902864 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2a46d16d-2976-4935-83f8-f964b3e47de4 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.168931 Sep 09 12:17:48.903466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 321/648] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:48 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:49.680508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:49.681148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:49.687416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.687902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.688338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:49.689032 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.689484 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.689909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:49.823654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:49.835448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:49.836918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:49.838025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-71e0afbb-6546-48dc-915c-7d0907698fb5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1408 microversion: 2.20 time: 0.162074 Sep 09 12:17:49.838572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 328/649] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:49 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:49.926238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:49.926774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:49.933517 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.933996 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.934429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:49.935148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.935604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.936016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:50.079497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:50.087790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0ebc96b2-114d-4454-8ab1-9b0de2efc96a tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1756 microversion: 2.1 time: 0.165528 Sep 09 12:17:50.088364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 322/650] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:49 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:50.862682 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:50.863341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:50.869396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:50.869872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:50.870300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:50.871049 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:50.871502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:50.872085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:50.890644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:51.005503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:51.014128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:51.017456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:51.017456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0cfbde37-0655-4475-994c-6d90675ee357 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1600 microversion: 2.20 time: 0.157955 Sep 09 12:17:51.017456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 329/651] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:50 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:17:51.042540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:51.043079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:51.045008 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:51.045698 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=12 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:51.052041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:51.052525 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:51.052957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:51.053646 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:51.054102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:51.054528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:51.111995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:51.112610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:51.118818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:51.119575 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:51.120291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:51.121031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:51.121494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:51.122567 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:51.132507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e5395cf4-10dc-4b7e-b84e-18428b1d767e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093795 Sep 09 12:17:51.133140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 323/652] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Sep 9 12:17:51 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:17:51.430971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:51.440141 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f38b24ac-49c5-401d-8415-ec7230289537 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1759 microversion: 2.1 time: 0.332267 Sep 09 12:17:51.450932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 330/653] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:51 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1759 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:52.150017 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:52.160088 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:52.160646 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:52.161104 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:52.172920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] Creating event network-changed:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:17:52.177666 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-54a1b6e4-2021-4bdd-acc7-a9185c6a505b req-314241b7-b750-4525-be05-92d5618a219d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Sep 09 12:17:52.178269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 324/654] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:53.739816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:53.740344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:53.746416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:53.747573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:53.748311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:53.749001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:53.749452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:53.749872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:53.774168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-09bac609-ad05-49b9-83fa-e112683de886 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/ips" status: 200 len: 148 microversion: 2.1 time: 0.037913 Sep 09 12:17:53.774731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 331/655] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:17:53 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:55.206287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "727fa56b-4d70-4ea5-b6e4-33b59e5b71c6"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:55.208847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:55.214997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:55.216150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:55.216751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:55.217435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:55.217882 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:55.218420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:55.456308 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-520a525d-0767-41f0-b804-0e0a94e1bdfb tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254896 Sep 09 12:17:55.456909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 325/656] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:17:55 2022] POST /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:02.254303 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:02.255028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:02.257019 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=44 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:02.262479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.262986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.263420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.264107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.264555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.264975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.345161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'services' on Instance uuid 31d8fc89-81a5-497c-b068-cc32e6905cea {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:02.415574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1a4def71-5cb4-44a7-9bd9-fc91c47f9c41 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments/e96f72dd-70b6-4405-a955-a60522f17e95" status: 202 len: 0 microversion: 2.1 time: 0.165133 Sep 09 12:18:02.416158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 332/657] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:18:02 2022] DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments/e96f72dd-70b6-4405-a955-a60522f17e95 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:02.427111 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:02.429397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:02.436304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.436793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.437247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.437989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.438447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.438868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.473598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7bb43491-a1b3-428c-9bbb-d005c6beeff5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051759 Sep 09 12:18:02.474181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 326/658] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:02 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:02.994456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "727fa56b-4d70-4ea5-b6e4-33b59e5b71c6"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:02.997340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.003499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.003985 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.004427 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.005120 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.005573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.005996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.097438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments HTTP/1.1 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 74 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:18:03.099193 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {"volumeAttachment": {"volumeId": "727fa56b-4d70-4ea5-b6e4-33b59e5b71c6"}} Sep 09 12:18:03.100840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'server_id': 'de381707-963b-4b31-824d-2dc1e3481dc5', 'body': {'volumeAttachment': {'volumeId': '727fa56b-4d70-4ea5-b6e4-33b59e5b71c6'}}} Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:03.101757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:03.103195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 400 to user: Invalid volume: volume 727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 is already attached to instances: de381707-963b-4b31-824d-2dc1e3481dc5 {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0e34b57b-8a88-4a0c-9111-23c6f3f3cdb3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110600 Sep 09 12:18:03.105066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 333/659] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:18:02 2022] POST /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:18:03.167438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.167933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.174248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.174737 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.175221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.175912 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.176366 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.176801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.259577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lazy-loading 'services' on Instance uuid de381707-963b-4b31-824d-2dc1e3481dc5 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:03.338717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0e755184-dd17-4847-b674-6c1b09e2e2a7 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments/727fa56b-4d70-4ea5-b6e4-33b59e5b71c6" status: 202 len: 0 microversion: 2.1 time: 0.174934 Sep 09 12:18:03.339559 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 327/660] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:18:03 2022] DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments/727fa56b-4d70-4ea5-b6e4-33b59e5b71c6 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:03.348001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.350138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.356046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.356805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.357270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.357933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.358394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.358811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.391968 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3751bda3-1ea0-4e09-9a97-119ad3302fc1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Sep 09 12:18:03.392520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 334/661] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:03 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:18:03.487814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.490019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.496717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.497237 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.497744 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.498439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.498916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.499352 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.528543 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ddcd7478-8485-4937-8a02-df83a0c9a93e tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045477 Sep 09 12:18:03.529139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 328/662] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:03 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:18:03.610351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.610885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.616784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.617261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.617691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.618370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.618819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.619263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.650138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:03.724784 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d4861bdf-40fd-48bf-9ca2-b510c55e75a2 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 204 len: 0 microversion: 2.1 time: 0.119029 Sep 09 12:18:03.725288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 335/663] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:03 2022] DELETE /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:03.734358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.734989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.741097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.741610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.742050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.742745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:03.743259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:03.743693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:03.883734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:03.891449 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e850bfca-3455-46f6-a237-639059902ed3 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1691 microversion: 2.1 time: 0.161777 Sep 09 12:18:03.892018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 329/664] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:03 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:04.405962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:04.408142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:04.414166 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.414651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.415132 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:04.415825 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.416290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.416717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:04.447448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b4265496-3bba-4fa4-a689-a5feb14080be tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Sep 09 12:18:04.447448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 336/665] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:04 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:04.915592 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:04.916229 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:04.922683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.923203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.923642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:04.924329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.924782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.925233 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:05.055895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:05.063842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-10ea37e3-d32f-4234-9cff-8558b11bbd12 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1691 microversion: 2.1 time: 0.152124 Sep 09 12:18:05.064411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 330/666] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:04 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:05.460129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:05.462250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:05.468518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:05.469002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:05.469441 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:05.470130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:05.470584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:05.471068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:05.499950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1eb3720f-bc18-491c-8a5e-4d9b9b29cdbc tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Sep 09 12:18:05.500498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 337/667] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:05 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:06.086680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:06.087309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:06.094106 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.094583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.095049 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.095736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.096187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.096610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.228080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:06.236662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7200a89a-89a4-49e6-b313-ff44a066d951 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1691 microversion: 2.1 time: 0.153852 Sep 09 12:18:06.237229 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 331/668] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:06 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:06.512838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:06.515012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:06.520983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.521840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.521942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.522565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.523048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.523474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.553297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d8746d8f-e8ec-4e40-8a36-fed2d29e68c0 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Sep 09 12:18:06.553860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 338/669] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:06 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:07.263689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:07.263689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.267612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.268091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.268520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.269207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.269653 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.270072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.417229 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:07.428255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fd51de50-77c3-4d8c-9063-458d2c369eaa tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1691 microversion: 2.1 time: 0.172061 Sep 09 12:18:07.438362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 332/670] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:07 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:07.565997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:07.568155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.574220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.574753 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.575235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.575931 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.576385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.576809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.606414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c1271084-d524-4f2e-93da-2ff9b7ebee57 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044146 Sep 09 12:18:07.607002 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 339/671] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:07 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:18:07.674035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:07.676872 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.680772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.681260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.681695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.682377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.682824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.683583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.708276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:07.760658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:07.795766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e4536a3f-cf0a-4b0c-bbac-ee07fad29af4 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 204 len: 0 microversion: 2.1 time: 0.125096 Sep 09 12:18:07.800324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 333/672] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:07 2022] DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:07.806641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:07.807228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.814037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.814546 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.815010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.815724 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.816185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.816610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.889312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:07.889936 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.896748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.897236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.897670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.898371 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.898823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.899288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.927860 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lazy-loading 'flavor' on Instance uuid 3d5b7583-00a7-42f5-9f11-a557b7a83c16 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:07.965987 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:07.977589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7470ae51-265d-4b38-b43f-b7bf6b736322 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1680 microversion: 2.1 time: 0.174336 Sep 09 12:18:07.978444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 340/673] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:07 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:08.018632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4339eb69-3e69-4c41-b9a4-4917b190d979 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "POST /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16/action" status: 202 len: 0 microversion: 2.1 time: 0.133759 Sep 09 12:18:08.019285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 334/674] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:18:07 2022] POST /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:18:08.028008 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:08.028690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:08.034794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:08.035298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:08.035732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:08.036432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:08.036883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:08.037301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:08.175007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:08.183310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b91a8f6f-384b-49be-bd7e-0b985949394a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.159572 Sep 09 12:18:08.184063 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 341/675] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:08 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:08.290934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d8fc89-81a5-497c-b068-cc32e6905cea", "name": "network-vif-deleted", "tag": "d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:08.300605 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:08.301262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:08.301769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:08.315266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] Creating event network-vif-deleted:d20dab4b-f9b0-45a9-9c1e-eec36b00e3a6 for instance 31d8fc89-81a5-497c-b068-cc32e6905cea on hv-cinder-85221 Sep 09 12:18:08.320165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-5db849e1-4ba5-4aa4-af7a-414c7ab00832 req-99a082e4-087f-4a5d-938d-9452275d5b20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Sep 09 12:18:08.320788 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 335/676] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:08.452949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:08.454067 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:08.460625 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:08.461419 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:08.461958 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:08.463020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:08.463828 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:08.464433 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:08.529342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:08.538144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e24e188b-8b3e-45dd-93c6-c27768e74f1c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1623 microversion: 2.1 time: 0.088928 Sep 09 12:18:08.549245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 342/677] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:08 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:09.003076 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:09.003794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:09.010175 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.010776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.011243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.012556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.013225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.013660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.153926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:09.162082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f8423186-d0f1-4117-87ee-22c5795ed134 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1680 microversion: 2.1 time: 0.163244 Sep 09 12:18:09.162882 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 336/678] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:08 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:09.207649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:09.208394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:09.214374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.215257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.215843 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.216596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.217125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.217621 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.358769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:09.367758 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e91463ca-59ba-439e-8925-a8b1b7b38663 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.163866 Sep 09 12:18:09.368677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 343/679] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:09 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:09.562461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:09.563116 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:09.570411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.570794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.571262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.571957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.572404 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.572828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.607027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:09.607519 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:09.608132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:09.608580 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'fault' on Instance uuid 31d8fc89-81a5-497c-b068-cc32e6905cea {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:09.659282 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:09.667500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-975399d3-d66b-4e0c-bce5-8c3b6ee8514d tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 200 len: 1335 microversion: 2.1 time: 0.109583 Sep 09 12:18:09.668649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 337/680] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:09 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:10.186240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:10.187218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:10.193202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.193697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.194135 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.194834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.195318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.195743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.200265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:10.265012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:10.275770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2dbb022f-9bc7-442c-aa5c-02b7843d9c33 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 200 len: 1613 microversion: 2.1 time: 0.094001 Sep 09 12:18:10.276438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 344/681] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:10 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:10.392499 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:10.393152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:10.401174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.401721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.403066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.403782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.404424 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.405027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.406139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de381707-963b-4b31-824d-2dc1e3481dc5", "name": "network-vif-deleted", "tag": "0a30b602-86bb-470c-afd6-a8e3923e8724"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:10.420116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.420607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.421044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.433666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] Creating event network-vif-deleted:0a30b602-86bb-470c-afd6-a8e3923e8724 for instance de381707-963b-4b31-824d-2dc1e3481dc5 on hv-cinder-85221 Sep 09 12:18:10.442860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-2093903e-ba47-417b-b981-4f761b5aa580 req-c83a90b1-3b6b-4d8a-b4ff-9bda9e1d9012 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040969 Sep 09 12:18:10.443492 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 345/682] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:18:10.698012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:10.698733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 31d8fc89-81a5-497c-b068-cc32e6905cea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:10.706260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.707121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.707800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.708764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:10.709284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:10.709921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:10.728165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] HTTP exception thrown: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Request method failure captured: Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea HTTP/1.1 Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3CnrLCJ6oOehmzbF8gFtuup_oiv1UdC2bs9O30p4ZpA3TgQ5RMWadleaQS7PixloHYcu9pAiQlgaLuEi7VfXswozZyukkpxsO6tDqfkjsYGQJX88xBaRJ89J0hdXS1j2ByLNqpn3Rd7k1KE3KSDaq-eaeUfDpqXzt7DefLkWXADPw Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:18:10.729918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 31411178e5c342b7bb14a21dec62f540 Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. Sep 09 12:18:10.731816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '31d8fc89-81a5-497c-b068-cc32e6905cea'} Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:10.732594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. Sep 09 12:18:10.733907 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:10.736536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Returning 404 to user: Instance 31d8fc89-81a5-497c-b068-cc32e6905cea could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:10.738059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b2aa6ffd-7611-4d9e-99ad-ced20ce81e6f tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea" status: 404 len: 111 microversion: 2.1 time: 0.043733 Sep 09 12:18:10.738634 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 346/683] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:10 2022] GET /compute/v2.1/servers/31d8fc89-81a5-497c-b068-cc32e6905cea => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:18:10.747857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9d17c36b-2fef-4bf8-9d81-f11968f7c6d5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '.version_select at 0x7f6bd0bd83a0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:10.773046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9d17c36b-2fef-4bf8-9d81-f11968f7c6d5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350184455" status: 202 len: 0 microversion: 2.1 time: 0.030107 Sep 09 12:18:10.774398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 347/684] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 9 12:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350184455 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:18:10.795633 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:10.804883 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b3d7b66d-22ec-4095-a119-a94608734db6 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.415947 Sep 09 12:18:10.805483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 338/685] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:10 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:11.305216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:11.305978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:11.314386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:11.314886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:11.315364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:11.316159 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:11.316558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:11.316983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:11.330966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 HTTP/1.1 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:18:11.332538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:18:11.334129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'de381707-963b-4b31-824d-2dc1e3481dc5'} Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:11.335167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:18:11.336611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:11.338074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:11.338074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4cb9aa5e-c3b9-4ee4-bcf0-d04031520045 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 404 len: 111 microversion: 2.1 time: 0.032854 Sep 09 12:18:11.343306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c015fffd-59c9-463b-af14-0bb5e93a7f28 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '.version_select at 0x7f6bd0bded30>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:11.350579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 348/686] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:11 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:18:11.365251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c015fffd-59c9-463b-af14-0bb5e93a7f28 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741864294" status: 202 len: 0 microversion: 2.1 time: 0.026218 Sep 09 12:18:11.367324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 339/687] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Sep 9 12:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741864294 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:11.829916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:11.830561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:11.836766 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:11.837253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:11.837689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:11.838392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:11.838853 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:11.840023 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:11.972949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:11.981346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-575a1f67-3c88-4f40-ae8e-d3f6931f981b tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.155334 Sep 09 12:18:11.981922 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 349/688] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:11 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:12.024045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d781c3ac-b674-40cf-8591-853a07b2b381 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: .version_select at 0x7f6bd0ca9d30>, body: {"keypair": {"name": "tempest-keypair-531438453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5FPze87I6q1JfWvo6SKs7jl761EaBtLJKs73gN8r6WZJA8mQZ3WuTbjj5VMdWpcTRXcFgi7ees52SHItCVNbqTSB4eMPEoMof92hwPrYvkyRGpKgdny/EBIMwzpsQ7hw=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:12.043513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d781c3ac-b674-40cf-8591-853a07b2b381 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:18:12.047457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d781c3ac-b674-40cf-8591-853a07b2b381 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:18:12.069535 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d781c3ac-b674-40cf-8591-853a07b2b381 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049472 Sep 09 12:18:12.070112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 340/689] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:18:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:13.005137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:13.005755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:13.012027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.012518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.012961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.013664 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.014123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.014556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.149881 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:13.158829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1085cd6f-7246-4d69-b66d-b45b3055d9c7 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.158162 Sep 09 12:18:13.159701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 350/690] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:12 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:13.313582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-57437722", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2"}], "security_groups": [{"name": "tempest-securitygroup--1732891021"}], "key_name": "tempest-keypair-531438453", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:13.419474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] validate_networks() for [('8ee8fd0e-c1e2-42f1-997f-6f1f09b9f8d2', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:18:13.712444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:13.712940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:13.719065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.719545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.719974 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.720656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.721102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.721519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.748601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:13.827358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-92e8d29c-ad6d-4ede-8195-d2215015866a tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 204 len: 0 microversion: 2.1 time: 0.118302 Sep 09 12:18:13.830885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 351/691] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:13 2022] DELETE /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:18:13.837128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:13.837937 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:13.844665 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.844805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:18:13.845170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.845289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:18:13.845633 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:18:13.845782 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.846035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:18:13.846362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.846480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:18:13.846804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.847389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.855080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.855869 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.856305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.857092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:13.857544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:13.857961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:13.881033 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:18:13.885233 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Getting quotas for user 2e125f66d9c84e9797099065351a07da and project 30fa27304a4f4d4ab05c7763bc346d57. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:18:13.897180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:18:13.899511 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:18:13.952658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d0c3e04b-8b55-4541-be99-31b3f1e80b42 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644301 Sep 09 12:18:13.953480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 341/692] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:18:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:18:13.964103 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8483f92e-227b-4d48-9f48-421c229cefc6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:13.964782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8483f92e-227b-4d48-9f48-421c229cefc6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:13.995172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:14.003880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1ee8fa42-d278-486f-b1c9-e68d9b6fc7c5 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1507 microversion: 2.1 time: 0.170987 Sep 09 12:18:14.004601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 352/693] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:13 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:14.029834 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8483f92e-227b-4d48-9f48-421c229cefc6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:14.037103 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8483f92e-227b-4d48-9f48-421c229cefc6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1239 microversion: 2.1 time: 0.076707 Sep 09 12:18:14.037665 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 342/694] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:13 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:14.184056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:14.184756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:14.191040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:14.191520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:14.191949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:14.192635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:14.193082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:14.193496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:14.333338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:14.341426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5eb7f64b-bcf4-4fab-84fe-74009695e9c9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.162190 Sep 09 12:18:14.342082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 353/695] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:14 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:15.028478 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:15.029087 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:15.036210 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.036690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.037124 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.037833 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.038281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.038701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.061138 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:15.061755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:15.067975 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.068610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.068940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.069665 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.070089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.070515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.135657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:15.144260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5c4dd5a6-6d5a-49e5-8d19-d95bbdd6c07e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1243 microversion: 2.1 time: 0.087262 Sep 09 12:18:15.144780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 354/696] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:15 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:15.196151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:15.204782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d84db240-bb85-4c91-bc03-3eecd642a6ec tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1507 microversion: 2.1 time: 0.181122 Sep 09 12:18:15.205332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 343/697] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:15 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:15.365195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:15.365884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:15.372372 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.372858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.373291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.373978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:15.374428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:15.374852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:15.502228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:15.510152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5a2b6cbe-df41-43bc-952b-95f1c7514794 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.148837 Sep 09 12:18:15.510715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 355/698] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:15 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:16.165951 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:16.166544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:16.169573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:16.174868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.175409 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.175824 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.176513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.176962 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.177386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.227348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:16.227963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:16.234827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.235349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.235801 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.236475 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.236929 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.237353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.243668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:16.251611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-275f8d5a-5daf-4dce-ad28-89df605d5661 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1235 microversion: 2.1 time: 0.089554 Sep 09 12:18:16.252177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 344/699] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:16 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:16.377026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:16.384972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-04ad9b6a-5c06-4cfe-832e-0ce70452e38c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1507 microversion: 2.1 time: 0.161385 Sep 09 12:18:16.385620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 356/700] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:16 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:16.533910 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:16.535649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:16.540553 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.541053 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.541492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.542337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:16.542802 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:16.543270 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:16.683900 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:16.692069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9dac59d6-366a-450a-8c7a-7edcad7ae605 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.162014 Sep 09 12:18:16.692660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 345/701] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:16 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:17.139678 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e2ea8-b146-4e6a-a71b-254e88b3275b", "name": "network-vif-deleted", "tag": "ae6e01ce-10c2-4dd8-b58a-1c3b79142a91"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:17.150247 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.150730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.151192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.165217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] Creating event network-vif-deleted:ae6e01ce-10c2-4dd8-b58a-1c3b79142a91 for instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b on hv-cinder-85221 Sep 09 12:18:17.174007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-090d7950-358e-480e-b76a-8d60689f6bca req-3b53df54-a016-46df-acf0-d729062f4930 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100494 Sep 09 12:18:17.174938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 357/702] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:17.275778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:17.276353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:17.283568 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.284057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.284496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.285205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.285660 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.286085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.360578 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:17.368743 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-22f91cba-7029-4cbd-822e-dce2ff1133e3 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1297 microversion: 2.1 time: 0.096843 Sep 09 12:18:17.369471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 346/703] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:17 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:17.411156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:17.411872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:17.418945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.419450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.419891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.420635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.421095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.421584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.455692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.456185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.456624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.457081 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'fault' on Instance uuid aa2e2ea8-b146-4e6a-a71b-254e88b3275b {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:17.524773 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:17.535863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-45fefd69-dbb3-4099-9b47-80c0ecb24e8c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 200 len: 1311 microversion: 2.1 time: 0.129682 Sep 09 12:18:17.548115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 358/704] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:17 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:17.717780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:17.718425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:17.724431 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.724921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.725359 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.726055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:17.726512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:17.726961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:17.884172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:17.893878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50c261d2-3e54-4330-a9c1-91343bbb9343 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.180540 Sep 09 12:18:17.895036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 347/705] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:17 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:18.397136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:18.397832 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:18.403939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.404432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.404873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.405570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.406027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.406452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.540209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:18.554611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b636e3be-cef0-401e-b5db-02ce13b7566d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.162134 Sep 09 12:18:18.555240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 359/706] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:18 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:18.563213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:18.563918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: aa2e2ea8-b146-4e6a-a71b-254e88b3275b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:18.570467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.571022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.571497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.572191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.572668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.573077 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.587564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] HTTP exception thrown: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Request method failure captured: Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b HTTP/1.1 Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3CnrLCJ6oOehmzbF8gFtuup_oiv1UdC2bs9O30p4ZpA3TgQ5RMWadleaQS7PixloHYcu9pAiQlgaLuEi7VfXswozZyukkpxsO6tDqfkjsYGQJX88xBaRJ89J0hdXS1j2ByLNqpn3Rd7k1KE3KSDaq-eaeUfDpqXzt7DefLkWXADPw Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:18:18.589265 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 31411178e5c342b7bb14a21dec62f540 Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. Sep 09 12:18:18.590807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'aa2e2ea8-b146-4e6a-a71b-254e88b3275b'} Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:18.591909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. Sep 09 12:18:18.593223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:18.594490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Returning 404 to user: Instance aa2e2ea8-b146-4e6a-a71b-254e88b3275b could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:18.594490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6c2fe555-2776-49a1-81ee-b0585de8d826 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b" status: 404 len: 111 microversion: 2.1 time: 0.032507 Sep 09 12:18:18.594490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 348/707] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:18 2022] GET /compute/v2.1/servers/aa2e2ea8-b146-4e6a-a71b-254e88b3275b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:18:18.600144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:18.600645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:18.607498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.607998 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.608442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.609148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.609723 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.610151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.646188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:18.700546 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:18.728845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d35d4574-6826-45d5-8853-f14ad797d7f1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 204 len: 0 microversion: 2.1 time: 0.132269 Sep 09 12:18:18.729936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 360/708] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:18 2022] DELETE /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:18.738413 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:18.739304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:18.745730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.746211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.746654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.747491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.747945 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.748371 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.882390 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:18.891018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-491bfa2a-304a-40b0-a226-c34ac5eca070 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.156533 Sep 09 12:18:18.891639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 349/709] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:18 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:18.920188 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:18.920812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:18.926620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.927142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.927575 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:18.928259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:18.928709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:18.929426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:19.064386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:19.072394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0d3410ac-29f9-4405-bcbc-66340a380c64 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.156560 Sep 09 12:18:19.072963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 361/710] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:18 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:19.192763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88afb85-69ce-4e87-83ef-8c6812b7ead2", "tag": "eca14a1e-ee31-43d5-a77f-0fb28cd2087c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:19.202357 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:19.202832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:19.203294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:19.214710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] Creating event network-changed:eca14a1e-ee31-43d5-a77f-0fb28cd2087c for instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 on hv-cinder-85221 Sep 09 12:18:19.219878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-0358e9c2-3181-436f-b430-eaa3e6f54b5c req-61ce85ff-bafb-48e7-8d0b-6ad25362bccf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 Sep 09 12:18:19.220641 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 350/711] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:19.580003 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:19.580617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:19.586616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:19.587136 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:19.587570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:19.588281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:19.588731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:19.589847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:19.723590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:19.731134 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e3a233d2-2956-4ca9-8ddc-bc4f65eaad1e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.154911 Sep 09 12:18:19.731698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 362/712] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:19 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:19.914581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:19.915234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:19.921932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:19.922420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:19.922857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:19.923573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:19.924031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:19.924457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:20.053195 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:20.061865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed1c7482-3197-471d-bd5d-d14ab98714e1 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.151647 Sep 09 12:18:20.062665 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 351/713] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:19 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:20.096999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:20.097665 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:20.104005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:20.105052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:20.105658 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:20.106445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:20.106995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:20.107473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:20.236974 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:20.244704 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-533323f2-2211-43ba-a08b-bfac36f4c529 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.152112 Sep 09 12:18:20.245839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 363/714] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:20 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:20.753501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:20.754112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:20.760089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:20.761155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:20.761998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:20.762714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:20.763216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:20.763643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:20.893915 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:20.902391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-974bc1c4-fb66-4b7c-a033-754865d976b1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.152673 Sep 09 12:18:20.902972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 352/715] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:20 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:21.084691 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:21.085294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:21.092259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.092741 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.093173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:21.093922 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.094308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.094728 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:21.221089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:21.228697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-376e0dc1-3146-4318-96b9-bc652a42476c tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.147877 Sep 09 12:18:21.229278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 364/716] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:21 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:21.268118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:21.268785 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:21.275144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.275624 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.276057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:21.276894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.277353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.277776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:21.409445 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:21.411705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:21.419500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b7516a10-d1ab-47df-89cf-b4e832597d8e tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.155223 Sep 09 12:18:21.420073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 353/717] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:21 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:21.925234 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:21.925878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:21.932168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.932877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.933324 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:21.934021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:21.934476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:21.934915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.107839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:22.117516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bbdaf0b6-08d6-4694-960c-1d20471bff6e tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.196027 Sep 09 12:18:22.131507 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 365/718] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:21 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:22.252975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:22.253710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:22.261335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:22.262008 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:22.262532 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.263456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:22.263915 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:22.264338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.442884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:22.443564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:22.449747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:22.450349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:22.450856 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.451650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:22.452179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:22.452674 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.468635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:22.478806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-98b05d76-17ed-4d5f-82dc-a0a60ae32261 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1522 microversion: 2.1 time: 0.229630 Sep 09 12:18:22.480252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 354/719] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:22 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:22.705355 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:22.713343 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-279e6e38-14fa-46ed-a270-08bbb2bdef63 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.274447 Sep 09 12:18:22.715491 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 366/720] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:22 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:22.763504 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bf6d84-bbe7-47cd-90f4-21b3a6eef971", "name": "network-vif-deleted", "tag": "dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:22.772836 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:22.773312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:22.773741 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:22.785240 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] Creating event network-vif-deleted:dd30fb13-c8fd-4d29-b2f7-ef6b8a4ad82e for instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 on hv-cinder-85221 Sep 09 12:18:22.789889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-b3aafedf-3fe7-4646-9347-c5d622ceebc6 req-b6dabd85-31cb-41ed-9fcd-3a63feaadede service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090775 Sep 09 12:18:22.790471 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 355/721] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:18:23.143785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:23.144501 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:23.152217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.153246 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.154179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.155096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.155764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.156339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.396202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:23.403961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a03f52e2-85e5-47c2-8d1d-73426dea7a09 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.266182 Sep 09 12:18:23.404523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 367/722] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:23 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:23.504891 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:23.505592 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:23.512829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.513313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.513749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.514443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.514946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.515382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.545722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.546201 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.546640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.547117 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'fault' on Instance uuid 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:23.588892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:23.596571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-11ea8393-7c79-46fe-aa56-e4236e5e3e56 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1312 microversion: 2.1 time: 0.096295 Sep 09 12:18:23.597130 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 356/723] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:23 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:23.737849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:23.738482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:23.744307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.745547 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.746039 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.746730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:23.747214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:23.747641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:23.881817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:23.889635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-86b58836-5365-41bd-b22e-cb8923c3ccdd tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.155601 Sep 09 12:18:23.890200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 368/724] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:23 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:24.426831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:24.427540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:24.429734 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:24.430416 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=12 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:24.437070 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.437599 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.438054 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.438728 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.439216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.439643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.578030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:24.585878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-403d2736-678d-411b-8a46-7222cc4a1979 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.162889 Sep 09 12:18:24.586446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 357/725] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:24 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:24.619508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:24.620980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:24.626995 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.627572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.628006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.628696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.629149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.629576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.660628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.661104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.661532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.661972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lazy-loading 'fault' on Instance uuid 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:24.705858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31411178e5c342b7bb14a21dec62f540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edbc1c04ea364f3bb335fd4ad0731d1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:24.713499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-940356e4-37c8-4167-a45e-eecce2dbc344 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 200 len: 1312 microversion: 2.1 time: 0.097791 Sep 09 12:18:24.714462 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 369/726] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:24 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:24.912852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:24.913474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:24.920767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.921254 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.921877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:24.922595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:24.923080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:24.923496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:25.158631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:25.167530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b2548239-72af-455d-9322-847745755ad3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.257761 Sep 09 12:18:25.168103 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 358/727] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:24 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:25.610714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:25.611676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:25.613843 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:25.621538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:25.622123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:25.622444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:25.623342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:25.623972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:25.624483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:25.735947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:25.736575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] [instance: 42bf6d84-bbe7-47cd-90f4-21b3a6eef971] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:25.742948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:25.743439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:25.743875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:25.744565 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:25.745120 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:25.745545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:25.759063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] HTTP exception thrown: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Request method failure captured: Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 HTTP/1.1 Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3CnrLCJ6oOehmzbF8gFtuup_oiv1UdC2bs9O30p4ZpA3TgQ5RMWadleaQS7PixloHYcu9pAiQlgaLuEi7VfXswozZyukkpxsO6tDqfkjsYGQJX88xBaRJ89J0hdXS1j2ByLNqpn3Rd7k1KE3KSDaq-eaeUfDpqXzt7DefLkWXADPw Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:18:25.760738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/edbc1c04ea364f3bb335fd4ad0731d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: edbc1c04ea364f3bb335fd4ad0731d1b Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1346125627 Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 31411178e5c342b7bb14a21dec62f540 Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1346125627-project Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. Sep 09 12:18:25.762412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '42bf6d84-bbe7-47cd-90f4-21b3a6eef971'} Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:25.763244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. Sep 09 12:18:25.764701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:25.766133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] Returning 404 to user: Instance 42bf6d84-bbe7-47cd-90f4-21b3a6eef971 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:25.766133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6a3bcf78-885c-4d21-b8e4-95dd06b0dfa7 tempest-ServerRescueNegativeTestJSON-1346125627 tempest-ServerRescueNegativeTestJSON-1346125627-project] 10.222.0.49 "GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971" status: 404 len: 111 microversion: 2.1 time: 0.030044 Sep 09 12:18:25.766133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 359/728] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:25 2022] GET /compute/v2.1/servers/42bf6d84-bbe7-47cd-90f4-21b3a6eef971 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:18:25.768958 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:25.777525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4663feda-2e2c-47e7-92e2-93c1c095d2ee tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.171611 Sep 09 12:18:25.778101 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 370/729] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:25 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:26.191191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:26.191722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:26.200114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.200594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.201027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.201720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.202173 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.202597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.599510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88afb85-69ce-4e87-83ef-8c6812b7ead2", "name": "network-vif-plugged", "status": "completed", "tag": "eca14a1e-ee31-43d5-a77f-0fb28cd2087c"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:26.608814 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.609563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.610183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.623757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] Creating event network-vif-plugged:eca14a1e-ee31-43d5-a77f-0fb28cd2087c for instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 on hv-cinder-85221 Sep 09 12:18:26.630370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-55f67cf3-0e2b-48fb-b2d1-932566c8d5c6 req-6525f2df-724b-4367-92ec-60bcbb7c1801 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099566 Sep 09 12:18:26.632208 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 371/730] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:18:26.691542 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:26.701337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-95060da6-0b67-45a3-8bbb-e72e98ee3601 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1510 microversion: 2.1 time: 0.513980 Sep 09 12:18:26.703475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 360/731] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:26 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:26.729311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:26.732257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:26.748790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.749458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.750386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.751962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.754361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.754876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.800982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:26.802066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:26.810756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.811490 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.812193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.813395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:26.813934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:26.814533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:26.928510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120591) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:18:26.997864 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b8f8b171-4c93-4e56-93bb-460a978c4769 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "POST /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16/action" status: 202 len: 0 microversion: 2.1 time: 0.274701 Sep 09 12:18:26.998651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 372/732] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:18:26 2022] POST /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:27.006369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:27.006925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:27.013603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:27.014097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:27.014534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:27.015281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:27.015737 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:27.016164 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:27.140520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:27.150496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-90910a23-04bb-4ea5-9bc3-8588d9aa9b6d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.353168 Sep 09 12:18:27.151929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 361/733] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:26 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:27.266474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:27.274522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ae530449-05aa-411d-aeb4-ae8f6d89cda9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1518 microversion: 2.1 time: 0.271824 Sep 09 12:18:27.275214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 373/734] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:27 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:28.177732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:28.178330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:28.188944 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:28.189497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:28.189985 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:28.190749 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:28.191239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:28.191664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:28.312778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:28.314389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:28.331716 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:28.332373 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:28.332956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:28.333840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:28.334986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:28.335570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:28.346307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:28.356743 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-05ccc3f4-05b1-4abc-b258-522f4278370d tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1365 microversion: 2.1 time: 0.182908 Sep 09 12:18:28.358282 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 362/735] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:28 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:28.483880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:28.503098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a4b72e9b-9032-42e0-8fd3-2b6009f9ce60 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1520 microversion: 2.1 time: 0.207069 Sep 09 12:18:28.503687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 374/736] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:28 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:28.651678 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "name": "network-vif-unplugged", "status": "completed", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:28.662206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:28.662921 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:28.663539 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:28.676462 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.compute.server_external_events [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] Unable to find a host for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16. Dropping event network-vif-unplugged {{(pid=120593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 12:18:28.677266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-c0d493f1-7315-46f2-b80b-ade616384ae0 req-66b4151d-e043-4373-a3f9-abf92d2f5971 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032092 Sep 09 12:18:28.678423 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 363/737] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 12:18:29.390195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:29.391295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:29.403850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.406407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.407211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.409596 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.410514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.411209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.531626 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:29.532259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:29.548508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.549512 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.550124 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.551420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.552353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.553231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.775860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:29.785624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e0c42db7-50bd-44e6-b996-52c0b10df255 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1555 microversion: 2.1 time: 0.403786 Sep 09 12:18:29.786353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 375/738] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:29 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:29.815014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:29.815615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:29.821782 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.822284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.823651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.824786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:29.825403 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:29.825989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:29.989110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:29.999179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d6cf605a-98bb-4f8c-aa7f-58794cf4f289 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.476297 Sep 09 12:18:29.999677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 364/739] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:29 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:30.002487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-71f73646-09e9-4902-bf4f-669df1140244 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194063 Sep 09 12:18:30.003229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 376/740] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:18:29 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:18:30.029557 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1623658475"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:30.030091 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:30.036128 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:30.036618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:30.037044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:30.037736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:30.038804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:30.039439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:30.691213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.network.security_group_api [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Removing security group c1e8fa1f-26a7-4269-8103-8f0f672c915d from port 9fd3a315-1c50-422b-b9e6-55e11c2d09ac Sep 09 12:18:31.025819 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:31.027406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:31.035941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:31.037436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:31.038356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:31.039710 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:31.041009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:31.042739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:31.049073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:31.449196 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:31.457681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5936791d-19cd-4ffd-8663-8732ad43f7da tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.435795 Sep 09 12:18:31.471028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 377/741] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:31 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:31.507304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-60cb3d61-7d20-4a61-ac85-2cae50d1d4f2 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action" status: 202 len: 0 microversion: 2.1 time: 1.481729 Sep 09 12:18:31.509003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 365/742] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:18:30 2022] POST /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/action => generated 0 bytes in 1484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:31.549266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:31.560627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:31.561483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:31.562315 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:31.579468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] Creating event network-changed:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:18:31.587612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-fce06054-618a-43e9-8e03-499cb7f9569d req-4bb8e9df-ee28-42f6-8583-466bfbb90130 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041359 Sep 09 12:18:31.589264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 378/743] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:32.485253 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:32.486221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:32.511638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:32.512143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:32.512971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:32.514518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:32.515225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:32.519467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:32.869074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:32.880118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-016ae380-73ea-4a16-8653-4f30d862af85 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.402294 Sep 09 12:18:32.881528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 366/744] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:32 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:33.168260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:33.168851 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:33.169946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:33.175898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.176649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.177409 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.178300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.179404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.180049 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.192075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.192868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.193392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.220162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] Creating event network-changed:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:18:33.228865 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-0dfd7301-66a2-4edf-b329-b19d7db58db4 req-3ae3a7de-0fba-43ad-86f4-8911382bab5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062911 Sep 09 12:18:33.234004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 367/745] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:33.347662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lazy-loading 'services' on Instance uuid fec9d75f-e761-4b0e-a831-dd30a679e3cc {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:33.458171 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2332f2b3-fe30-409c-970e-c6c6e2a80fbc tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments/a97a70a8-47c6-4102-b0a1-38b630710a71" status: 202 len: 0 microversion: 2.1 time: 0.294827 Sep 09 12:18:33.459112 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 379/746] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:18:33 2022] DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments/a97a70a8-47c6-4102-b0a1-38b630710a71 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:33.469483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:33.472464 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:33.491534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.492792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.493602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.496012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.496703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.498505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.536475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c3de7c87-86b2-41ba-9733-02aaf27f0b63 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072251 Sep 09 12:18:33.537708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 368/747] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:33 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:33.607736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88afb85-69ce-4e87-83ef-8c6812b7ead2", "tag": "eca14a1e-ee31-43d5-a77f-0fb28cd2087c"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:33.625538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.626013 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.629375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.647374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] Creating event network-changed:eca14a1e-ee31-43d5-a77f-0fb28cd2087c for instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 on hv-cinder-85221 Sep 09 12:18:33.656589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-f5e740ee-feb7-4617-9068-3f7609cf313a req-bb0ebcb0-1395-4fe0-9a86-50deabb1664c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053408 Sep 09 12:18:33.659818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 380/748] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:33.910378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:33.911971 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:33.921575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.924780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.928475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:33.929757 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:33.930429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:33.931089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:34.397147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:34.407955 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-579bd44b-5722-48e1-b82f-66ea0de3c7a0 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.502561 Sep 09 12:18:34.408529 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 369/749] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:33 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:34.550795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:34.553010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:34.567777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:34.568282 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:34.568727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:34.570198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:34.571446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:34.571887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:34.610110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3d1e47ac-c2e8-4053-a592-91a014251ab1 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063976 Sep 09 12:18:34.610783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 381/750] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:18:34 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:18:34.622885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:34.623451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:34.655204 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:34.656096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:34.661360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:34.662345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:34.663719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:34.664500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:34.755068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] HTTP exception thrown: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc is not attached to volume a97a70a8-47c6-4102-b0a1-38b630710a71 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Request method failure captured: Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments/a97a70a8-47c6-4102-b0a1-38b630710a71 HTTP/1.1 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy6Bz4bpXFgvZG_mCjyqFrZ5U9QrHPVbYZ6YGpO0-IF9_S8GAcuHMCBLzQEV3pGUwrfDjEDaF1XkHcYtqD3bXFk044K40-THt-piOdhQW7Ui_kg_sBDEtki0J9ZPBHY8O3V9wDoe9mKVrOBVSnC2GvCX0ghtTjsHp0bLMXfmL774jNY Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: baec172d59054da499387e85a4b8727e Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:18:34.757679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/baec172d59054da499387e85a4b8727e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_baec172d59054da499387e85a4b8727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/baec172d59054da499387e85a4b8727e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/baec172d59054da499387e85a4b8727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: baec172d59054da499387e85a4b8727e Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-TestMinimumBasicScenario-669445411-project Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: eb42a8cde3044a4b9df5cb81d82d9910 Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestMinimumBasicScenario-669445411-project Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:18:34.759340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc is not attached to volume a97a70a8-47c6-4102-b0a1-38b630710a71 Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'server_id': 'fec9d75f-e761-4b0e-a831-dd30a679e3cc', 'id': 'a97a70a8-47c6-4102-b0a1-38b630710a71'} Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a97a70a8-47c6-4102-b0a1-38b630710a71. Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:34.760397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc is not attached to volume a97a70a8-47c6-4102-b0a1-38b630710a71 Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc is not attached to volume a97a70a8-47c6-4102-b0a1-38b630710a71 Sep 09 12:18:34.761555 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:18:34.763880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Returning 404 to user: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc is not attached to volume a97a70a8-47c6-4102-b0a1-38b630710a71 {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:34.764763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f5281efb-6d6f-4b06-9d7f-6e813a4ff9c3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments/a97a70a8-47c6-4102-b0a1-38b630710a71" status: 404 len: 154 microversion: 2.1 time: 0.147496 Sep 09 12:18:34.765342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 370/751] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:18:34 2022] DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc/os-volume_attachments/a97a70a8-47c6-4102-b0a1-38b630710a71 => generated 154 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:18:35.432165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:35.432805 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:35.438883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:35.439402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:35.439838 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:35.440531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:35.440982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:35.441407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:35.589252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:35.596963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a54d852d-db9b-4fa6-8e3a-917a83adb18a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.169483 Sep 09 12:18:35.597703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 382/752] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:35 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:35.920802 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:35.921301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:35.927855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:35.928334 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:35.929019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:35.929732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:35.930176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:35.930594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:35.962982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:36.014756 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:36.046858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-70c5cfed-9b64-4d2b-baf1-c3fde256b860 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 204 len: 0 microversion: 2.1 time: 0.130623 Sep 09 12:18:36.047623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 371/753] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:35 2022] DELETE /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:36.058003 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:36.058707 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:36.064619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.065114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.065552 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.066252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.066703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.067167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.211319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:36.222442 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-72c4a384-2c7a-4cd3-9085-a88f00055c69 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1554 microversion: 2.1 time: 0.169477 Sep 09 12:18:36.231045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 372/754] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:36 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:36.264785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:36.265262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:36.271139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.271619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.272792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.272792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.273179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.273595 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.299194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c122f92d-531a-40e9-b538-570f76958f30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/ips" status: 200 len: 151 microversion: 2.20 time: 0.325747 Sep 09 12:18:36.299939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 383/755] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Sep 9 12:18:35 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/ips => generated 151 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:18:36.620619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:36.621232 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:36.634323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.635446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.635898 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.636599 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:36.637058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:36.637488 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:36.776144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:36.783925 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a2411c0e-aaba-45b1-9969-d23302a29ba3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.167329 Sep 09 12:18:36.784496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 373/756] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:36 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:37.247341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:37.247945 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:37.253792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:37.254281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:37.254725 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:37.255451 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:37.255912 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:37.256339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:37.388911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:37.396639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c92df14d-2eee-4d31-a7d9-519947b47e4f tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1554 microversion: 2.1 time: 0.153379 Sep 09 12:18:37.397207 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 384/757] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:37 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:37.809527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:37.810142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:37.819073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:37.819557 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:37.819991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:37.820687 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:37.821140 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:37.821565 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:37.971342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:37.979190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a39b4f98-115a-4277-a602-064f07e5508f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.174127 Sep 09 12:18:37.979760 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 374/758] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:37 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:38.163378 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:38.163914 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:38.170513 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.171037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.171478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.172170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.172626 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.173051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.197349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lazy-loading 'flavor' on Instance uuid 20459e13-27e0-44fb-b11c-920df8aefc5b {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:38.383344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c43e4100-5395-4cfb-a6bd-b01d68e5cd51 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/action" status: 202 len: 0 microversion: 2.20 time: 0.223826 Sep 09 12:18:38.383938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 385/759] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 9 12:18:38 2022] POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:38.392148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:38.392797 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:38.398744 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.399261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.399692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.400991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.401612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.402068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.421048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:38.422028 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:38.428896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.429393 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.429837 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.430543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.431203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.432331 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.590486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:38.600635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:38.602387 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:38.604116 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c3d3bf31-f49a-47e1-a3ea-22e219822934 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.215839 Sep 09 12:18:38.604772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 375/760] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:38 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:38.622065 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb42a8cde3044a4b9df5cb81d82d9910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baec172d59054da499387e85a4b8727e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:38.635710 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-788b072a-c7fe-4d1e-8bb4-5905bfb4c4d3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 200 len: 1554 microversion: 2.1 time: 0.218087 Sep 09 12:18:38.636534 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 386/761] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:38 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:38.965620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec9d75f-e761-4b0e-a831-dd30a679e3cc", "name": "network-vif-deleted", "tag": "9fd3a315-1c50-422b-b9e6-55e11c2d09ac"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:38.976589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:38.977074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:38.977508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:38.989702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] Creating event network-vif-deleted:9fd3a315-1c50-422b-b9e6-55e11c2d09ac for instance fec9d75f-e761-4b0e-a831-dd30a679e3cc on hv-cinder-85221 Sep 09 12:18:38.995400 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-f29d1351-9c55-4404-b571-fab2f7c1f735 req-310849f8-efdf-4281-bcab-917a26c851b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033252 Sep 09 12:18:38.999248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 376/762] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:39.004176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:39.004786 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:39.011498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.012210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.012646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.013337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.013951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.014389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.156637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:39.171530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-15c2eaf1-b232-454a-a030-6c87cf673e39 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.171223 Sep 09 12:18:39.172107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 387/763] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:38 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:18:39.635599 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:39.636302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:39.642659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.643207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.643645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.644348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.644804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.645234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.663512 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:39.664227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] [instance: fec9d75f-e761-4b0e-a831-dd30a679e3cc] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:39.671702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.672666 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.673180 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.674032 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:39.674489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:39.674940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:39.690069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] HTTP exception thrown: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Request method failure captured: Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc HTTP/1.1 Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy6Bz4bpXFgvZG_mCjyqFrZ5U9QrHPVbYZ6YGpO0-IF9_S8GAcuHMCBLzQEV3pGUwrfDjEDaF1XkHcYtqD3bXFk044K40-THt-piOdhQW7Ui_kg_sBDEtki0J9ZPBHY8O3V9wDoe9mKVrOBVSnC2GvCX0ghtTjsHp0bLMXfmL774jNY Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: baec172d59054da499387e85a4b8727e Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:18:39.692300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/baec172d59054da499387e85a4b8727e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_baec172d59054da499387e85a4b8727e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/baec172d59054da499387e85a4b8727e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/baec172d59054da499387e85a4b8727e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: baec172d59054da499387e85a4b8727e Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestMinimumBasicScenario-669445411 Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-TestMinimumBasicScenario-669445411-project Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: eb42a8cde3044a4b9df5cb81d82d9910 Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestMinimumBasicScenario-669445411-project Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. Sep 09 12:18:39.693876 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'fec9d75f-e761-4b0e-a831-dd30a679e3cc'} Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:39.694708 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. Sep 09 12:18:39.695986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:18:39.697614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Returning 404 to user: Instance fec9d75f-e761-4b0e-a831-dd30a679e3cc could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:39.697614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-13ad936d-feff-4c5c-bcac-bf5fd9df7005 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc" status: 404 len: 111 microversion: 2.1 time: 0.037180 Sep 09 12:18:39.697614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 388/764] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:39 2022] GET /compute/v2.1/servers/fec9d75f-e761-4b0e-a831-dd30a679e3cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:18:39.703122 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-21370af7-5e9f-4185-b902-285444926fe3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] Calling method '.version_select at 0x7f6bd0b39310>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:39.721926 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-21370af7-5e9f-4185-b902-285444926fe3 tempest-TestMinimumBasicScenario-669445411 tempest-TestMinimumBasicScenario-669445411-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-864059863" status: 202 len: 0 microversion: 2.1 time: 0.022564 Sep 09 12:18:39.722496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 389/765] 10.222.0.49 () {58 vars in 1269 bytes} [Fri Sep 9 12:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-864059863 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:18:39.785293 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:39.793430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:39.794889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:39.796074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-75544c3c-6471-4bf3-a6a1-01a5bab1a856 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.169294 Sep 09 12:18:39.796643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 377/766] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:39 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:40.195833 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:40.196448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:40.204781 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:40.205268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:40.205706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:40.206396 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:40.206844 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:40.207297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:40.345994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:40.355898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1f4c18b0-d88c-4d6c-9441-96f5aa93b7e5 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.163803 Sep 09 12:18:40.356556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 390/767] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:40 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:40.822880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:40.824242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:40.830858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:40.831613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:40.832052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:40.832898 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:40.833379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:40.833969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:41.087233 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:41.105340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:41.107386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:41.108774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e94d5fbd-55d1-4dbf-b454-68e9d5711a30 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.290943 Sep 09 12:18:41.109630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 378/768] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:40 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:41.379940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:41.380555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:41.387518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:41.388009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:41.388438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:41.389357 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:41.389989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:41.390420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:41.599163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:41.609499 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5334bd1f-8868-4197-ade8-3040a0e72a91 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.233321 Sep 09 12:18:41.610172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 391/769] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:41 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:42.135947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:42.136570 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:42.143031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:42.143746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:42.144367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:42.145257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:42.145875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:42.146477 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:42.382085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:42.393804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:42.395854 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:42.397046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4810de14-97aa-4a7d-a5c4-3943394f3fe4 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.265611 Sep 09 12:18:42.397584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 379/770] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:42 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:42.633487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:42.634195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:42.644504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:42.645000 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:42.645868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:42.646778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:42.647434 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:42.648712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:42.803219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "name": "network-vif-plugged", "status": "completed", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:42.830656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:42.839367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:42.840162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:42.841197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:42.843027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2f2c04a2-a5eb-4efb-9931-4f65e4d67ed3 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.213459 Sep 09 12:18:42.846960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 392/771] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:42 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:42.875895 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] Creating event network-vif-plugged:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:18:42.880850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-4265e26f-6ca9-4f11-8fce-00b82deb76ad req-cd05369d-a66e-4e76-859b-53d0cae78c7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083915 Sep 09 12:18:42.881747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 380/772] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:43.424056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:43.424695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:43.431583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:43.433147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:43.433597 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:43.434302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:43.434827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:43.438243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:43.588869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:43.598115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:43.599733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:43.601048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e4a50114-5c2f-42d0-9d10-bccf1d9c752f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.181460 Sep 09 12:18:43.601676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 393/773] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:43 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:43.874439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:43.875167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:43.883644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:43.884940 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:43.886433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:43.887430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:43.888356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:43.888969 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:44.104821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:44.113364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5667abdf-b755-4bf5-885d-5231a6c0c5d9 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1576 microversion: 2.1 time: 0.245759 Sep 09 12:18:44.113940 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 381/774] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:43 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:44.632505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:44.633170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:44.639155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:44.639638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:44.640097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:44.645632 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:44.646109 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:44.646541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:44.667336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:44.802533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:44.812698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:44.815315 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:44.816916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7af36a36-a45d-459c-bd71-559ccb876bcd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.193552 Sep 09 12:18:44.818039 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 394/775] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:44 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:45.138533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:45.139150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:45.145689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:45.146170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:45.146606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:45.147313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:45.147764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:45.148185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:45.280575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:45.288346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cfa53fdb-d8aa-47c3-b9c4-d6be90e98333 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1563 microversion: 2.1 time: 0.154415 Sep 09 12:18:45.288914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 382/776] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:45 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:45.846310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:45.846957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:45.854369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:45.854869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:45.855508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:45.856035 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:45.856496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:45.856923 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:46.014168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:46.022706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:46.024199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:46.025954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a2911c93-053b-4ab4-8f60-937d55206b44 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.185426 Sep 09 12:18:46.026520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 395/777] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:45 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:47.052022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:47.052638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:47.055186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:47.062144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:47.062639 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:47.063134 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:47.064133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:47.067936 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:47.068386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:47.290596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:47.306816 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:47.311395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:47.313831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-36b174b9-e8da-4ad2-b27e-7c9d4b1370de tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.265914 Sep 09 12:18:47.314407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 383/778] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:47 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:48.345351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:48.345979 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:48.353553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.354298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.354740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.356719 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.357305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.357628 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.535006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:48.548173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:48.550535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:48.552085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e8826d3-4e95-4f49-9e02-cbab3d505a74 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.211622 Sep 09 12:18:48.553891 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 396/779] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:48 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:18:49.584060 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:49.584662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:49.592450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:49.592989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:49.593455 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:49.594226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:49.594682 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:49.595132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:49.733845 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:49.742263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:49.744637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:49.745805 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a5d79a1d-a02e-4756-aa0d-f309194a231d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1745 microversion: 2.20 time: 0.165599 Sep 09 12:18:49.752637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 384/780] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:49 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:50.776592 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:50.777210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:50.783564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:50.784053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:50.784623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:50.785502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:50.785973 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:50.786401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:50.926956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:50.936176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:50.937698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:50.938854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-545af3ea-5c44-421c-96b9-c72d25096666 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1745 microversion: 2.20 time: 0.170133 Sep 09 12:18:50.939584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 397/781] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:50 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:51.972247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:51.973170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:51.985710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:51.987275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:51.988052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:51.989027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:51.990006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:51.990531 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:52.158558 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:52.169464 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:52.171056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:52.172461 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-36b5c907-b63d-431a-827f-6a7342b9c488 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.207554 Sep 09 12:18:52.173025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 385/782] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:51 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:52.609715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "name": "network-vif-plugged", "status": "completed", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:52.626681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:52.627528 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:52.628150 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:52.642144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] Creating event network-vif-plugged:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:18:52.650271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-bb87fb80-5cb2-42da-95c8-2848a6266cf1 req-e4f597c8-9541-487b-a1c5-4f3058e4e626 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043635 Sep 09 12:18:52.651385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 398/783] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:53.202974 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:53.204444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:53.211313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:53.212095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:53.212698 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:53.213980 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:53.215493 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:53.216585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:53.373393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:53.382498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:53.384996 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:53.386270 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-93e844da-2c62-43f2-bde6-b34b25e26d6d tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.189355 Sep 09 12:18:53.403522 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 386/784] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:53 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:54.421809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:54.424072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:54.433217 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:54.433731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:54.434224 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:54.435095 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:54.435650 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:54.436306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:54.630600 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:54.641768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:54.644185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:54.645877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1213ae57-9115-4511-bdc4-212bc2380312 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.229084 Sep 09 12:18:54.646561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 399/785] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:54 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:55.691238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:55.693006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:55.701144 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:55.702004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:55.702638 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:55.703593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:55.704249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:55.706883 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:55.893314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:55.904550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:55.906238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:55.907616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bdc22cab-eda9-455d-9daa-b9fca820627b tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.238400 Sep 09 12:18:55.908318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 387/786] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:55 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:56.937687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:56.939022 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:56.944695 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:56.948192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:56.948824 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:56.949374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:56.950363 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:56.951089 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:56.951747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:57.121416 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:57.130309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:57.135468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:57.136834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5745bc80-6092-409c-9f3d-b95576a7b59e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.206233 Sep 09 12:18:57.138082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 400/787] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:56 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:18:58.168378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:58.169123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:58.176188 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:58.176670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:58.177322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:58.178292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:58.178742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:58.179459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:58.338163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:58.348176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:58.350050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:58.351313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2f8b7d95-d734-4f3b-a706-df2f81fe9427 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.188033 Sep 09 12:18:58.352444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 388/788] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:58 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:18:59.382064 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:59.382713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:59.388978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:59.389713 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:59.390306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:59.391187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:59.391795 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:59.392374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:59.560261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:59.575231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:59.576966 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:59.578764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ce57087-eacf-4641-a943-cea2f0d8a620 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.201076 Sep 09 12:18:59.580244 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 401/789] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:18:59 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:00.610397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:00.612989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:00.623321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:00.623819 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:00.624304 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:00.625012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:00.625643 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:00.626252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:00.672072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:00.841351 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:00.850509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:00.852219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:00.853558 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-764ff7c7-3378-47fd-9b0c-e401062d9fe2 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1740 microversion: 2.20 time: 0.247056 Sep 09 12:19:00.854117 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 389/790] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:00 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:01.883517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:01.884126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:01.890259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:01.890824 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:01.891504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:01.892209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:01.892667 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:01.893121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:02.039469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:02.047971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:02.049333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:02.050530 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a8922cb4-3561-4adc-8cfa-da0b72db53af tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1722 microversion: 2.20 time: 0.170942 Sep 09 12:19:02.051344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 402/791] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:01 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:03.080254 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:03.080855 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:03.087446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:03.087923 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:03.088350 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:03.089032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:03.089480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:03.089901 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:03.219015 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:03.227850 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:03.229302 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:03.230441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1422a880-b539-46d8-b827-5c4158a3e330 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1722 microversion: 2.20 time: 0.154102 Sep 09 12:19:03.231013 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 390/792] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:03 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:04.256014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:04.256620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:04.263574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.264151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.264603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.265312 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.265771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.266203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.403006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:04.412154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:04.413747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:04.414969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5d13b3f4-5dd0-45a8-b7d8-4779d9987d0a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1725 microversion: 2.20 time: 0.162920 Sep 09 12:19:04.415559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 403/793] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:04 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:04.440207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc26b396-3bb7-4a57-9bfb-4384b53c0bc9"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:04.442606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:04.451298 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.451785 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.452217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.453090 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.453663 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.454171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.724289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d98074dc-3dd4-48d2-8939-373d22c6e0da tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287999 Sep 09 12:19:04.725178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 391/794] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Sep 9 12:19:04 2022] POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:19:04.850307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:04.850809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:04.856912 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.857398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.857868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.858601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.859087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.859510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.095443 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-570b95ee-650d-44a0-b288-a0ca6f4546ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments/cc26b396-3bb7-4a57-9bfb-4384b53c0bc9" status: 202 len: 0 microversion: 2.20 time: 0.248869 Sep 09 12:19:05.095883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 404/795] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Sep 9 12:19:04 2022] DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments/cc26b396-3bb7-4a57-9bfb-4384b53c0bc9 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:05.160014 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:05.160609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:05.167408 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.167897 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.168335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.169034 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.169484 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.169908 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.200701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:19:05.277445 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4b7ed7b4-7729-4a70-b77a-8abfd896b4d9 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/action" status: 202 len: 0 microversion: 2.20 time: 0.121398 Sep 09 12:19:05.278071 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 392/796] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Sep 9 12:19:05 2022] POST /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:05.287010 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:05.288352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:05.296271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.296823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.297487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.298271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.301336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.301848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.474759 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:05.485486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:05.487265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:05.488797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-13457281-980b-4ccc-b1af-54a6f76e2f54 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1673 microversion: 2.20 time: 0.206302 Sep 09 12:19:05.489332 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 405/797] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:05 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:19:06.516677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:06.517329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:06.523948 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:06.524430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:06.524869 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:06.525566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:06.526021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:06.526448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:06.629747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "name": "network-vif-unplugged", "status": "completed", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:06.645583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:06.646484 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:06.647050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:06.660440 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] Creating event network-vif-unplugged:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:19:06.667908 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-e60cc07c-32af-4b60-9b74-910a1f0c2882 req-5138aca5-bdb1-42eb-9347-eba102535dc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042199 Sep 09 12:19:06.668836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 406/798] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:19:06.681231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:06.692248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:06.693693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:06.695127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-29f6a9c8-81d5-44f0-84c3-1c0227d8dd08 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.183638 Sep 09 12:19:06.695697 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 393/799] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:06 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:07.723832 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:07.725517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:07.732949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:07.733439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:07.733886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:07.734591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:07.735104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:07.735531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:07.911356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:07.921614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:07.923105 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:07.924302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-073efe67-9fec-4ea3-9933-de8f4f61931a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.206373 Sep 09 12:19:07.924865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 407/800] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:07 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:08.203692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:08.205133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:08.214642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.215337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.215779 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.216489 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.216939 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.217354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.247518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50e01088-f206-4f7b-8826-9f982267c426 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/ips" status: 200 len: 150 microversion: 2.1 time: 0.049424 Sep 09 12:19:08.248105 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 394/801] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:19:08 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:08.952006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:08.952616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:08.959286 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.959783 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.960223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.960964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.961426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.961845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:09.143711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:09.153388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:09.155657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:09.156961 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-05010793-93b1-42d1-97ec-fe75416211c1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.208763 Sep 09 12:19:09.160276 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 408/802] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:08 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:09.704021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "438e56d2-cf81-4d89-b9f3-c5654d50a5e7"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:09.707300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:09.716330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:09.717082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:09.717669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:09.718608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:09.719335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:09.719986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.184724 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:10.186261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:10.193382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:10.194414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:10.195211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.196265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:10.196887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:10.197482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.369436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:10.378053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:10.379803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:10.383008 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-689a539a-769c-40db-b20b-fa21e7c9e5db tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.200828 Sep 09 12:19:10.384102 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 409/803] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:10 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:11.414319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:11.415794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:11.424748 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.425642 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.426307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.427300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.428252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.428888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.433198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:11.688599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:11.698824 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:11.700697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:11.702085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c50451c6-270b-46b8-87d9-fb90c7916685 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.291857 Sep 09 12:19:11.713647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 410/804] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:11 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:12.732259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:12.732935 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:12.739309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.740068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.740512 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.741220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.741707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.742326 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.892259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:12.902059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:12.903636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:12.904942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-db7d2d31-881e-4047-9892-09d952e84c1e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.176600 Sep 09 12:19:12.905544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 411/805] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:12 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:19:13.945936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:13.946498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:13.965184 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.965817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.966335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:13.967092 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.967548 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.967969 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.121858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:14.133800 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:14.135601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:14.137139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dab96174-199e-4ce0-8063-5c512c4d99e1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.209888 Sep 09 12:19:14.137951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 412/806] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:13 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:19:15.165507 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:15.166909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:15.175302 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.175932 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.176476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.177311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.178346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.179111 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.354054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:15.366151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:15.368589 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:15.374035 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9eb81271-c775-49b5-bd57-49c5ef647927 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.214068 Sep 09 12:19:15.387559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 413/807] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:15 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:19:16.401133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:16.401757 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:16.407721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.408214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.408715 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.409412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.409868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.410674 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.543048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.551223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.552901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.554361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-96f6f914-e979-4c90-a8d4-90b8ba44456a tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.157462 Sep 09 12:19:16.555144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 414/808] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:16 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:19:17.160395 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-230cce8f-bb05-4c20-8792-9e1cf18feaa1 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "POST /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.460643 Sep 09 12:19:17.160992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 395/809] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:19:09 2022] POST /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments => generated 194 bytes in 7462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:17.580614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:17.581245 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:17.588024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.588502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.588930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.589603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.590047 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.590460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.724121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.733040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.734483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.735670 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c50dd66a-6a97-45ec-a407-4508a89faa01 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.159144 Sep 09 12:19:17.736229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 415/810] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:17 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:18.763436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:18.764131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:18.766109 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:18.772597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.773096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.773523 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.774259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.774717 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.775176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.914115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.922503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.923967 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.925129 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8b9e1c27-c06a-458d-ac00-c1d0991c6978 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.167012 Sep 09 12:19:18.926062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 396/811] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:18 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:19.954262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:19.955647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:19.966868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.968088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.968088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.968865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.969641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.974493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.120219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:20.128227 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:20.129653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:20.130794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3d4214e7-0967-4e7c-9336-205543f48b58 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.180690 Sep 09 12:19:20.131374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 416/812] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:19 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:20.722344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "name": "network-vif-plugged", "status": "completed", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:20.734841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:20.735362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:20.735795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.747426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] Creating event network-vif-plugged:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:19:20.752485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-4340f987-d4a1-43b1-8993-84260c126ba4 req-e3c90d96-cebc-417a-b955-7c98a4b607a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Sep 09 12:19:20.753083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 397/813] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:21.158059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:21.158616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:21.164764 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.165247 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.165681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:21.166370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.166818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.167264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:21.295272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:21.304177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:21.305633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:21.306789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a493beb8-d059-4e2e-b9c4-c95fae304e6f tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.152814 Sep 09 12:19:21.307383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 417/814] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:21 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:22.334444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:22.335947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:22.342742 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.343421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.343716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.344454 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.344852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.345275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.493207 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.505871 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.508814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.510092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1d9cb118-86f2-48be-aa83-a1e23785b9ff tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1731 microversion: 2.20 time: 0.180437 Sep 09 12:19:22.514946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 398/815] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:22 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:23.537605 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.539017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.545239 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.545858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.546421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.547339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.547827 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.548261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.678872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.687152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.688585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.689812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d4468c42-251b-41c5-9c6b-2eb75b3deba1 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1718 microversion: 2.20 time: 0.156406 Sep 09 12:19:23.690386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 418/816] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:23 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:23.774733 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.775283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.781607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.782186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.782621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.783343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.783798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.784220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.864631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lazy-loading 'services' on Instance uuid e88afb85-69ce-4e87-83ef-8c6812b7ead2 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:23.934952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1f0be2d5-7109-4f5c-81f9-7b74e7967752 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments/438e56d2-cf81-4d89-b9f3-c5654d50a5e7" status: 202 len: 0 microversion: 2.1 time: 0.164401 Sep 09 12:19:23.935475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 399/817] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:19:23 2022] DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments/438e56d2-cf81-4d89-b9f3-c5654d50a5e7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:23.943707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.946442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.952438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.952934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.953450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.954192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.954651 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.955285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.985731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7e90ccc2-f8f4-4fe6-995e-d9833ccd3d84 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045872 Sep 09 12:19:23.986290 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 419/818] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:23 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:24.998806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:25.001143 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:25.007833 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.008305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.008735 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.009414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.009863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.010285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.040142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d60150c4-9e27-4853-8d75-0600ab9ba08a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046111 Sep 09 12:19:25.040689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 400/819] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:24 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:19:25.108818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:25.109336 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:25.115214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.115711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.116162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.116851 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.117335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.117762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.141762 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:19:25.221133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1a651721-0d5c-46dd-8905-759279aa10ad tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 204 len: 0 microversion: 2.1 time: 0.115778 Sep 09 12:19:25.221730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 420/820] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:25 2022] DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:25.230930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:25.231505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:25.237619 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.238096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.238530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.239236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.239690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.240111 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.254715 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:25.373357 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:25.380979 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-149a2303-87fe-435d-98a1-3d4d35c0745a tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1680 microversion: 2.1 time: 0.153980 Sep 09 12:19:25.382092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 401/821] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:25 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:26.406866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:26.408195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:26.415689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:26.416318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:26.416878 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.417593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:26.418054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:26.418478 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.559497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:26.567754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2ac8c952-7aef-43f4-bec5-85ca997379dd tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1680 microversion: 2.1 time: 0.165637 Sep 09 12:19:26.568494 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 421/822] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:26 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:27.557480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88afb85-69ce-4e87-83ef-8c6812b7ead2", "name": "network-vif-deleted", "tag": "eca14a1e-ee31-43d5-a77f-0fb28cd2087c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:27.592270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:27.592847 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:27.598266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:27.603531 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.604216 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.604831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.616354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.616858 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.617297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.618052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.618453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.618872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.627038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] Creating event network-vif-deleted:eca14a1e-ee31-43d5-a77f-0fb28cd2087c for instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 on hv-cinder-85221 Sep 09 12:19:27.635919 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-3d41b162-7568-4909-9dc3-53c107630970 req-697f4e4f-4974-4ee9-9382-a840e0f7c2a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083779 Sep 09 12:19:27.637226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 402/823] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:27.726040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e125f66d9c84e9797099065351a07da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fa27304a4f4d4ab05c7763bc346d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:27.737866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f7745f8c-57ea-4b29-842d-99542d2154d9 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 200 len: 1324 microversion: 2.1 time: 0.150003 Sep 09 12:19:27.755885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 422/824] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:27 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:28.765960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:28.766658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:28.773714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:28.774194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:28.774620 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:28.775330 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:28.775780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:28.776262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:28.790026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 HTTP/1.1 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:28.791608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:28.793360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'e88afb85-69ce-4e87-83ef-8c6812b7ead2'} Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:28.794376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:28.795918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:28.797754 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:28.797754 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a8ba5142-76a7-4b53-bb30-a50a28ff4852 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 404 len: 111 microversion: 2.1 time: 0.032639 Sep 09 12:19:28.797754 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 403/825] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:28 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:28.801943 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-53c30d27-a4c3-4657-a755-c5fd87cd6d32 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '.version_select at 0x7f6bd0cbd550>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:28.822774 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-53c30d27-a4c3-4657-a755-c5fd87cd6d32 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531438453" status: 202 len: 0 microversion: 2.1 time: 0.024575 Sep 09 12:19:28.823434 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 423/826] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 9 12:19:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531438453 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:30.610081 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:30.610611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:30.618594 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.619314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.619759 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.620463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.620916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.621338 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.635955 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 HTTP/1.1 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:30.637514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.639125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'e88afb85-69ce-4e87-83ef-8c6812b7ead2'} Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:30.640096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.641373 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.642631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:30.642631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c1d799ad-460f-4542-9dc8-78427d5d44e2 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 404 len: 111 microversion: 2.1 time: 0.033504 Sep 09 12:19:30.642631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 404/827] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:30 2022] DELETE /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:30.653145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:30.653763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: e88afb85-69ce-4e87-83ef-8c6812b7ead2] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:30.660163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.660655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.661098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.662008 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.662503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.662957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.679601 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 HTTP/1.1 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:19:30.681253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.683444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'e88afb85-69ce-4e87-83ef-8c6812b7ead2'} Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:30.684862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. Sep 09 12:19:30.686370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:30.688417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance e88afb85-69ce-4e87-83ef-8c6812b7ead2 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:30.688417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2cf66ee0-a4be-46cc-bda8-80961e5e2235 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2" status: 404 len: 111 microversion: 2.1 time: 0.034192 Sep 09 12:19:30.688417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 424/828] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:30 2022] GET /compute/v2.1/servers/e88afb85-69ce-4e87-83ef-8c6812b7ead2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:31.831875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:31.832376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:31.839652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.840137 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.840579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.841272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.841729 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.842155 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.856160 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 HTTP/1.1 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:31.857689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.859349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'de381707-963b-4b31-824d-2dc1e3481dc5'} Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:31.860420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.861858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.863590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:31.863590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bb05be72-3fd1-46f5-bc43-9fa3da62ce34 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 404 len: 111 microversion: 2.1 time: 0.031048 Sep 09 12:19:31.863590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 405/829] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:31 2022] DELETE /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:31.868167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:31.868769 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: de381707-963b-4b31-824d-2dc1e3481dc5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:31.874770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.875271 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.875701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.876376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.876834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.877235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.891107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 HTTP/1.1 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:19:31.892604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.894149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'de381707-963b-4b31-824d-2dc1e3481dc5'} Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:31.895195 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. Sep 09 12:19:31.897250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.898736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance de381707-963b-4b31-824d-2dc1e3481dc5 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:31.898736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e0366bc8-0b23-4a04-a607-8097902a8ccf tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5" status: 404 len: 111 microversion: 2.1 time: 0.030114 Sep 09 12:19:31.898736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 425/830] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:31 2022] GET /compute/v2.1/servers/de381707-963b-4b31-824d-2dc1e3481dc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:31.903053 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:31.903550 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:31.909547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.910025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.910460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.911171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.911622 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.912041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.925767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 HTTP/1.1 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:31.927618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.929392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '49cbcd0c-7039-4918-a52c-75870c5b8000'} Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:31.930269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.931862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.933598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:31.933598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-04cc7053-bb2a-4233-9819-40bac2929620 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 404 len: 111 microversion: 2.1 time: 0.030060 Sep 09 12:19:31.933598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 406/831] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:31 2022] DELETE /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:19:31.937439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:31.938030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: 49cbcd0c-7039-4918-a52c-75870c5b8000] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:31.944151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.944624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.945054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.945724 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.946170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.946588 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.961014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 HTTP/1.1 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:19:31.962486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.964301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '49cbcd0c-7039-4918-a52c-75870c5b8000'} Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:31.965407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. Sep 09 12:19:31.967167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:31.968834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance 49cbcd0c-7039-4918-a52c-75870c5b8000 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:31.968834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-65da8d39-1fb6-4126-85ac-366b8a07e015 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000" status: 404 len: 111 microversion: 2.1 time: 0.030294 Sep 09 12:19:31.968834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 426/832] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:31 2022] GET /compute/v2.1/servers/49cbcd0c-7039-4918-a52c-75870c5b8000 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:33.104118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:33.104614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:33.111042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.111530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.111970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.112662 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.113121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.113548 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.127402 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 HTTP/1.1 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:33.128957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.130513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'df0cb5c6-89f6-4231-8311-7ddbe2693c70'} Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:33.131755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.133180 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.134832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:33.134832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1d5778cf-a200-4e48-9d2c-6e2e6a7585f6 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 404 len: 111 microversion: 2.1 time: 0.030940 Sep 09 12:19:33.134832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 407/833] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:33 2022] DELETE /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:33.138653 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:33.139297 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] [instance: df0cb5c6-89f6-4231-8311-7ddbe2693c70] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:33.145129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.145607 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.146037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.147256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.147723 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.148141 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.161066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] HTTP exception thrown: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Request method failure captured: Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 HTTP/1.1 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3FB4vNCRSFjmaHDpGzyDPYnqa3d2y7GM4eBt1KW0_A0mpy4dThOW9ar9IYZhEvwYE93bE8odfT9zqpbFpRW1GqOkBgqEl_fAheaMn69X7Hoe_59eq47vOY9jbLEqU9EBmyBbrOMS7h6WGzQ1BHWIgX1X9wOGe2twp4TSEGMP-eIDY Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:19:33.163251 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/30fa27304a4f4d4ab05c7763bc346d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 30fa27304a4f4d4ab05c7763bc346d57 Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-533998822 Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 2e125f66d9c84e9797099065351a07da Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-533998822-project Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.164906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'df0cb5c6-89f6-4231-8311-7ddbe2693c70'} Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:33.165967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. Sep 09 12:19:33.167464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:19:33.169021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] Returning 404 to user: Instance df0cb5c6-89f6-4231-8311-7ddbe2693c70 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:33.169021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c93ddb54-be05-474e-8498-6b79b7344281 tempest-AttachVolumeNegativeTest-533998822 tempest-AttachVolumeNegativeTest-533998822-project] 10.222.0.49 "GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70" status: 404 len: 111 microversion: 2.1 time: 0.029746 Sep 09 12:19:33.169021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 427/834] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:33 2022] GET /compute/v2.1/servers/df0cb5c6-89f6-4231-8311-7ddbe2693c70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:55.253131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:55.256505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:55.259502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=23 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:55.260271 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=15 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:55.266604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.267342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.267793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.268469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.268916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.269602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.301169 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-163077ac-c4a8-4ab8-b1ba-1c290d234bba tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051887 Sep 09 12:19:55.308306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 408/835] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Sep 9 12:19:55 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:55.369101 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:55.369632 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:55.372344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:55.373057 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:55.379017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.379559 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.380325 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.381041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.381496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.381919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.409999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:19:55.486712 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-af6a531a-3b59-40a7-bad1-b6b376bd45a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 204 len: 0 microversion: 2.20 time: 0.121470 Sep 09 12:19:55.487498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 428/836] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 9 12:19:55 2022] DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:19:55.497376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:55.498217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:55.505682 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.506177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.506654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.507344 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.507795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.508369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.642959 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:55.652062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:55.653527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:55.654684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2b2febf9-1c9e-40a6-ad1d-0363bec8713e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.161532 Sep 09 12:19:55.655262 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 409/837] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:55 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:56.683770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:56.684475 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:56.691323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:56.691850 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:56.693479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:56.694197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:56.694660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:56.695170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:56.859226 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:56.868723 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:56.870636 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:56.872099 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a5560276-c724-498b-bbcd-d400e3297f4e tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1724 microversion: 2.20 time: 0.192892 Sep 09 12:19:56.872855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 429/838] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:56 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:57.681677 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20459e13-27e0-44fb-b11c-920df8aefc5b", "name": "network-vif-deleted", "tag": "850819fb-ec79-4dfb-a246-33409feb9708"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:57.697613 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.698200 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.698695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.713605 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] Creating event network-vif-deleted:850819fb-ec79-4dfb-a246-33409feb9708 for instance 20459e13-27e0-44fb-b11c-920df8aefc5b on hv-cinder-85221 Sep 09 12:19:57.720690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-c9fb8dbb-f66c-45ef-83b0-889fac8715b8 req-c5792958-496a-41d5-914f-8d9a489d2766 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043109 Sep 09 12:19:57.721755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 410/839] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:57.899570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:57.900823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:57.907568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.908235 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.908782 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.909668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.910196 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.911334 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.944445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.945185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.945627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.946082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lazy-loading 'fault' on Instance uuid 20459e13-27e0-44fb-b11c-920df8aefc5b {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:57.992202 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:58.002450 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:58.004066 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a5c9fb3f664ae097f0c3ce6f6c0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2f72b6ae8d3482e935d3375bc999732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:58.005515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1de539ae-a8ea-4046-97e7-6063c80e08b5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 200 len: 1372 microversion: 2.20 time: 0.110570 Sep 09 12:19:58.006200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 430/840] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:57 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:19:59.033414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:59.034294 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:59.043166 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:59.043652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:59.044086 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:59.044777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:59.045230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:59.045655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:59.061602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b HTTP/1.1 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:19:59.063625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:19:59.065554 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '20459e13-27e0-44fb-b11c-920df8aefc5b'} Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:59.066640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:19:59.068276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:19:59.069607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:59.069607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a1dc8820-8e34-4d50-a351-1f2012c68d18 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 404 len: 111 microversion: 2.20 time: 0.036604 Sep 09 12:19:59.069607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 411/841] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:19:59 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:19:59.074619 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c190f777-c596-41ab-8059-0eea21ea3868 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '.version_select at 0x7f6bd0af8790>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:59.093746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c190f777-c596-41ab-8059-0eea21ea3868 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094560161" status: 204 len: 0 microversion: 2.20 time: 0.023022 Sep 09 12:19:59.094399 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 431/842] 10.222.0.49 () {60 vars in 1262 bytes} [Fri Sep 9 12:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094560161 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:20:00.835064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:00.835567 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:00.841908 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:00.842385 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:00.842811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:00.843530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:00.843975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:00.844391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:00.858122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b HTTP/1.1 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:20:00.859649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.861269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '20459e13-27e0-44fb-b11c-920df8aefc5b'} Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:00.862231 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.864430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.866065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:00.866065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c55d6290-5a23-478c-8e75-b3efd23946bd tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 404 len: 111 microversion: 2.20 time: 0.030359 Sep 09 12:20:00.866065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 412/843] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 9 12:20:00 2022] DELETE /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:20:00.870469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:00.871175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 20459e13-27e0-44fb-b11c-920df8aefc5b] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:00.877005 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:00.877490 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:00.877931 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:00.878616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:00.879291 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:00.879591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:00.893073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b HTTP/1.1 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:20:00.895275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.897031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '20459e13-27e0-44fb-b11c-920df8aefc5b'} Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:00.899254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. Sep 09 12:20:00.900633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:00.902012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 20459e13-27e0-44fb-b11c-920df8aefc5b could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:00.902012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9fcf2dc9-3f87-4028-8011-507d415b8e45 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b" status: 404 len: 111 microversion: 2.20 time: 0.030121 Sep 09 12:20:00.902012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 432/844] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:20:00 2022] GET /compute/v2.1/servers/20459e13-27e0-44fb-b11c-920df8aefc5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:20:02.037056 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:02.037530 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:02.044863 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:02.045339 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:02.045766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:02.046444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:02.046889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:02.047327 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:02.063012 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 HTTP/1.1 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:20:02.064556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.066192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '578576a5-5165-4c3b-b095-1ca6461b2610'} Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:02.067101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.068446 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.069810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:02.069810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3468db73-f323-4d1a-bb01-0bcf2c15fdc8 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 404 len: 111 microversion: 2.20 time: 0.033565 Sep 09 12:20:02.069810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 413/845] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Sep 9 12:20:02 2022] DELETE /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:20:02.074400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:02.075053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] [instance: 578576a5-5165-4c3b-b095-1ca6461b2610] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:02.080916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:02.081391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:02.081824 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:02.082870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:02.083345 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:02.083773 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:02.096765 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] HTTP exception thrown: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Request method failure captured: Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 HTTP/1.1 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy3Sx_W0gvclrXFwoZ5QhOX36BhvqJ1YIUJ-rnQEQKRKPOh8fPGv_9bCpwYFSb4UkS-6BbLJxOvBu7zxYD4SmAWMJYX8UcUmbPoR9P5ZL9XMzcT2M70xFj3B-pR1MV2aCxNQdEXztvVSWijH5R8gJMd9O4NpGQmcj-t4Bw0crV5hkj4 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:20:02.099257 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2f72b6ae8d3482e935d3375bc999732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: f2f72b6ae8d3482e935d3375bc999732 Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1014460693 Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: b9a5c9fb3f664ae097f0c3ce6f6c0764 Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1014460693-project Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.100933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '578576a5-5165-4c3b-b095-1ca6461b2610'} Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:02.101978 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. Sep 09 12:20:02.103458 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:02.104875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] Returning 404 to user: Instance 578576a5-5165-4c3b-b095-1ca6461b2610 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:02.104875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-aa0dec2f-2cd1-4949-a546-c2f760d8c4a5 tempest-AttachVolumeShelveTestJSON-1014460693 tempest-AttachVolumeShelveTestJSON-1014460693-project] 10.222.0.49 "GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610" status: 404 len: 111 microversion: 2.20 time: 0.030018 Sep 09 12:20:02.104875 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 433/846] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Sep 9 12:20:02 2022] GET /compute/v2.1/servers/578576a5-5165-4c3b-b095-1ca6461b2610 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:20:03.670436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:03.678292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:03.680806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:03.698102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:03.700152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:03.701159 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:03.703787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:03.706038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:03.707600 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:03.709226 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:03.710212 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:03.711350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:03.750473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] Creating event network-changed:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:20:03.765275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-5680586b-3138-4938-9863-fc32923db156 req-189d3735-9850-4651-8d39-b17aa7c26917 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091308 Sep 09 12:20:03.768034 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 434/847] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:03.793825 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:20:03.913546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1860f9f6-9a7d-4c44-9457-5f95db89288f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 204 len: 0 microversion: 2.1 time: 0.248047 Sep 09 12:20:03.914127 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 414/848] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:20:03 2022] DELETE /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:20:03.925038 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:03.926493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:03.933714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:03.934457 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:03.935075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:03.936106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:03.936693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:03.937385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:04.095305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:04.106950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d8e0d3a6-069f-460e-8d81-369a1059d03a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.187464 Sep 09 12:20:04.107914 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 435/849] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:03 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:05.137751 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:05.139026 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:05.146019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:05.146501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:05.146966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:05.147917 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:05.148382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:05.148786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:05.344759 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:05.354761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-660fa23a-ea68-4e2d-87c6-809eae57f54a tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1569 microversion: 2.1 time: 0.226093 Sep 09 12:20:05.373635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 415/850] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:05 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:06.278843 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5b7583-00a7-42f5-9f11-a557b7a83c16", "name": "network-vif-deleted", "tag": "b31a4066-e807-4756-a7e5-7417e12f26ee"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:06.295536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:06.304811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:06.305584 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:06.326354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] Creating event network-vif-deleted:b31a4066-e807-4756-a7e5-7417e12f26ee for instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 on hv-cinder-85221 Sep 09 12:20:06.332420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-742d8816-db1c-4df5-a1d6-aaec2d7ba18c req-f76ebc39-b63d-4e40-82fd-f63c9e52ed9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056868 Sep 09 12:20:06.333362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 436/851] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:06.382934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:06.383561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:06.392162 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:06.393312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:06.393920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:06.395042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:06.395710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:06.396503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:06.494148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9750f671d674447f9fbf36d382573c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0570ae08fc40ccb3dd942591098d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:06.518774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7a1b5454-b9db-4ee8-bd68-5cba57d6df0f tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 200 len: 1220 microversion: 2.1 time: 0.140141 Sep 09 12:20:06.520479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 416/852] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:06 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:07.550365 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:07.551700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] [instance: 3d5b7583-00a7-42f5-9f11-a557b7a83c16] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:07.558200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:07.558681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:07.559126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:07.559721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:07.560166 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:07.560581 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:07.577075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] HTTP exception thrown: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Request method failure captured: Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 HTTP/1.1 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy43Yi_LJx3U9070c77jkTolpo_1vbP0uOuuMiWYkk9dWSMVs8VErXzi_bcCGUSgQLg7ToyV8QWFMl5rwTv_ZszHX2oJl15v6cnAFVPsi07VOBgsIgb40AJg9md4L2S7TI2rch5uo1Q81tSGe7wvflPp6BzBGiWl-DSmmshr0-0Hokk Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 6b0570ae08fc40ccb3dd942591098d34 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestShelveInstance-1008484789 Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:20:07.578829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6b0570ae08fc40ccb3dd942591098d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6b0570ae08fc40ccb3dd942591098d34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b0570ae08fc40ccb3dd942591098d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6b0570ae08fc40ccb3dd942591098d34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestShelveInstance-1008484789 Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 6b0570ae08fc40ccb3dd942591098d34 Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestShelveInstance-1008484789 Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-TestShelveInstance-1008484789-project Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 9750f671d674447f9fbf36d382573c37 Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestShelveInstance-1008484789-project Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. Sep 09 12:20:07.580543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '3d5b7583-00a7-42f5-9f11-a557b7a83c16'} Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:07.581306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. Sep 09 12:20:07.584053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:20:07.586466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Returning 404 to user: Instance 3d5b7583-00a7-42f5-9f11-a557b7a83c16 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:07.586466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-35c9e6c1-7fb4-44d9-996d-a23f90de2a59 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16" status: 404 len: 111 microversion: 2.1 time: 0.034008 Sep 09 12:20:07.586466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 437/853] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:07 2022] GET /compute/v2.1/servers/3d5b7583-00a7-42f5-9f11-a557b7a83c16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:20:07.791447 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b5620658-0372-4cdd-b492-370f9aba3fd1 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] Calling method '.version_select at 0x7f6bd0b72d30>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:07.817941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b5620658-0372-4cdd-b492-370f9aba3fd1 tempest-TestShelveInstance-1008484789 tempest-TestShelveInstance-1008484789-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2045061559" status: 202 len: 0 microversion: 2.1 time: 0.030581 Sep 09 12:20:07.824970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 417/854] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Sep 9 12:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2045061559 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:20:16.041621 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-610883c8-7028-443f-8135-45e72e3d3060 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: .version_select at 0x7f6bd0af8b80>, body: {"keypair": {"name": "tempest-keypair-206483036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMml11t0nYK+8ehkcd+R3B0ZcJNNoKLxtQRVndDrVdpUbBcr9+dsx5GP8KHy/3mxIsHyfnxd7LxlGuxq7/z180W7oz9X0WSPncQEKV531MdVmlezi54ag9c3depV5tuq2w=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:16.061755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-610883c8-7028-443f-8135-45e72e3d3060 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:20:16.068205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-610883c8-7028-443f-8135-45e72e3d3060 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for user 870f5366f958496d93c51e4b573e2487 and project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:20:16.103123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-610883c8-7028-443f-8135-45e72e3d3060 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.229559 Sep 09 12:20:16.104349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 438/855] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:20:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:18.358449 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:18.359284 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:18.365514 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1891802590", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5aabc735-25cb-4def-82b4-34d6ed0ea6a0"}], "security_groups": [{"name": "tempest-securitygroup--120477824"}], "key_name": "tempest-keypair-206483036", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:18.493747 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] validate_networks() for [('5aabc735-25cb-4def-82b4-34d6ed0ea6a0', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:20:19.025476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:20:19.025978 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:20:19.026545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:20:19.027067 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:20:19.027582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:20:19.038584 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:19.039218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:19.039721 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:19.040545 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:19.041061 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:19.041702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:19.061957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:20:19.067399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for user 870f5366f958496d93c51e4b573e2487 and project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:20:19.080006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:20:19.082368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:20:19.134420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-398565e1-5800-414c-bd01-1d09a151e08e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.777614 Sep 09 12:20:19.135019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 418/856] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:20:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:20:19.143385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:19.148449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-109b49fd-93d5-4665-9216-f0933e7f0cbf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:19.149079 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-109b49fd-93d5-4665-9216-f0933e7f0cbf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:19.221379 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-109b49fd-93d5-4665-9216-f0933e7f0cbf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:19.230390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-109b49fd-93d5-4665-9216-f0933e7f0cbf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1237 microversion: 2.1 time: 0.087274 Sep 09 12:20:19.240342 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 439/857] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:19 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:20.266078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:20.266737 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:20.278946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:20.280703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:20.281257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:20.282179 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:20.282847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:20.283429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:20.372759 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:20.382961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0094087f-292c-4998-912e-7c60ea9c8ec2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1307 microversion: 2.1 time: 0.122154 Sep 09 12:20:20.383846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 419/858] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:20 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:21.407172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:21.407890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:21.414711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:21.415233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:21.415702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:21.416392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:21.416846 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:21.417270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:21.636094 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:21.649001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0e797034-a326-42cd-92ec-31f4e49dc044 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.245458 Sep 09 12:20:21.650026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 440/859] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:21 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:22.033988 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92414745-4f7c-41ec-bcec-e2d6736c9786", "tag": "800902ce-8946-4c3d-bb11-c2f5a3c30da2"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:22.046109 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:22.046842 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:22.047785 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:22.060753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] Creating event network-changed:800902ce-8946-4c3d-bb11-c2f5a3c30da2 for instance 92414745-4f7c-41ec-bcec-e2d6736c9786 on hv-cinder-85221 Sep 09 12:20:22.069405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-7071c3d4-8dab-4ab4-95f8-f5603355a336 req-3a02a5ad-c9dc-489c-8d0b-91f88f2b9010 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039247 Sep 09 12:20:22.070022 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 420/860] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:22.671696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:22.672318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:22.678714 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:22.679266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:22.679706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:22.680420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:22.680863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:22.681295 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:22.812467 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:22.820649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-747b379d-e2e5-4194-a1ec-40b83b99716a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.152837 Sep 09 12:20:22.821219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 441/861] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:22 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:23.845145 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:23.845849 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:23.852556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:23.853035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:23.853495 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:23.854176 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:23.854625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:23.855097 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:23.982411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:23.990631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cec09159-b969-4421-8606-c85dd655b966 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.150132 Sep 09 12:20:23.991228 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 421/862] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:23 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:25.013536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:25.014155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:25.020094 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:25.020585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:25.021026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:25.021727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:25.022185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:25.022609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:25.177606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:25.185508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf35c8b7-8d77-43f8-847b-0315d449357b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.175851 Sep 09 12:20:25.186081 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 442/863] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:25 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:26.208745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:26.209982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:26.216681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:26.217163 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:26.217595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:26.218289 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:26.218743 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:26.219205 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:26.352702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:26.363600 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-666fd1ff-1cbf-4831-80c7-2961618a126c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.158648 Sep 09 12:20:26.373907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 422/864] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:26 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:27.300535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92414745-4f7c-41ec-bcec-e2d6736c9786", "name": "network-vif-plugged", "status": "completed", "tag": "800902ce-8946-4c3d-bb11-c2f5a3c30da2"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:27.305692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:27.311531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:27.312021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:27.312488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:27.325151 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] Creating event network-vif-plugged:800902ce-8946-4c3d-bb11-c2f5a3c30da2 for instance 92414745-4f7c-41ec-bcec-e2d6736c9786 on hv-cinder-85221 Sep 09 12:20:27.330144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-9e3ecf6b-776b-4c75-ab0a-d5fd02dfe967 req-af8c3314-4760-477f-a723-164bedd7990d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034267 Sep 09 12:20:27.330957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 443/865] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:27.386336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:27.387470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:27.396487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:27.396977 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:27.397560 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:27.398257 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:27.398706 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:27.399149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:27.600101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:27.608041 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a355b9fc-3731-49f0-aaf2-9e937851668a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1362 microversion: 2.1 time: 0.225572 Sep 09 12:20:27.608600 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 423/866] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:27 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:28.635166 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:28.636132 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:28.644540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:28.645050 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:28.645496 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:28.646211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:28.647219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:28.647219 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:28.785569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:28.793345 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-11e7bbda-2e80-4fc3-97ae-d0e4807e3137 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1548 microversion: 2.1 time: 0.162966 Sep 09 12:20:28.793909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 444/867] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:28 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:28.817762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:28.818313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:28.824623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:28.825099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:28.825547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:28.826245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:28.826695 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:28.827146 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:28.918946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-93144b54-c631-4857-8299-fd5c8e3ea8e6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105277 Sep 09 12:20:28.920731 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 424/868] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:20:28 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:29.856474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92414745-4f7c-41ec-bcec-e2d6736c9786", "tag": "800902ce-8946-4c3d-bb11-c2f5a3c30da2"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:29.861468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:29.868521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:29.869100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:29.869624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:29.882308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] Creating event network-changed:800902ce-8946-4c3d-bb11-c2f5a3c30da2 for instance 92414745-4f7c-41ec-bcec-e2d6736c9786 on hv-cinder-85221 Sep 09 12:20:29.887366 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-84bcb89d-d081-4b66-8764-fd752b507406 req-a3f34b46-67f0-460f-a8f7-6e7b33412cca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Sep 09 12:20:29.887953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 445/869] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:33.663950 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:33.664739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:33.669285 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-323691974", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:33.721602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] validate_networks() for None {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:20:34.236683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:20:34.237326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:20:34.237799 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:20:34.238202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:20:34.238607 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:20:34.247571 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:34.248052 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:34.248485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:34.249199 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:34.249646 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:34.250064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:34.267192 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Getting quotas for project 192b3c1dcb7a4d9c952420130039ea6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:20:34.271429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Getting quotas for user c0781112ec0c440da34254add94a593a and project 192b3c1dcb7a4d9c952420130039ea6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:20:34.282063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:20:34.285153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:20:34.331701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4e19b37e-f223-479e-b66e-f28302874a3f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668546 Sep 09 12:20:34.332347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 425/870] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:20:34.343668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-474ec76b-8585-4b51-a45a-220d753ff575 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:34.344360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-474ec76b-8585-4b51-a45a-220d753ff575 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:34.402164 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-474ec76b-8585-4b51-a45a-220d753ff575 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:34.410561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-474ec76b-8585-4b51-a45a-220d753ff575 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1214 microversion: 2.1 time: 0.070714 Sep 09 12:20:34.411380 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 446/871] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:34 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:35.434868 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:35.435420 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:35.442380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:35.442874 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:35.443337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:35.444043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:35.444500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:35.444926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:35.507392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:35.515042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7785fa08-c9f0-4906-8623-5be2c1f730de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1272 microversion: 2.1 time: 0.085317 Sep 09 12:20:35.515610 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 426/872] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:35 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:36.538826 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:36.539606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:36.546368 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:36.546997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:36.547524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:36.548272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:36.548857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:36.549254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:36.774269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:36.781921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-846483e1-3d66-4dd3-84ce-86653f3716de tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1314 microversion: 2.1 time: 0.247290 Sep 09 12:20:36.782585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 447/873] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:36 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:36.931147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f187fba-1e6e-4a9a-bf81-24b1944a5ffe", "tag": "169de6c7-75e7-482d-a725-0d02293d52d0"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:36.942689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:36.943202 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:36.943632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:36.958352 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] Creating event network-changed:169de6c7-75e7-482d-a725-0d02293d52d0 for instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe on hv-cinder-85221 Sep 09 12:20:36.963656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-31ad042d-5ba5-458f-b48a-a0f4e2bfea9a req-9e25f3b6-a0cf-4cf2-b32a-e8f6e2576f3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036738 Sep 09 12:20:36.964259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 427/874] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:37.805340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:37.805949 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:37.811879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:37.812360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:37.812791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:37.813469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:37.813918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:37.814532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:37.943919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:37.951434 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d32aec34-a373-4457-a898-9251e72c08be tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1314 microversion: 2.1 time: 0.149924 Sep 09 12:20:37.951991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 448/875] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:37 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:38.976082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:38.976694 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:38.982861 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:38.983372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:38.983803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:38.984689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:38.985141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:38.985562 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:39.117828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:39.125444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ab283645-6595-4dc1-8afc-0b425bb19204 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1314 microversion: 2.1 time: 0.154134 Sep 09 12:20:39.126011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 428/876] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:38 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:40.148446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:40.148990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:40.155115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:40.155602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:40.156044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:40.156743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:40.157198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:40.157673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:40.289488 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:40.297085 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c4ec8285-883a-47ea-a244-c949a8b5d198 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1314 microversion: 2.1 time: 0.152643 Sep 09 12:20:40.297656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 449/877] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:40 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:41.210956 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f187fba-1e6e-4a9a-bf81-24b1944a5ffe", "name": "network-vif-plugged", "status": "completed", "tag": "169de6c7-75e7-482d-a725-0d02293d52d0"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:41.222725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:41.223242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:41.223703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:41.234812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] Creating event network-vif-plugged:169de6c7-75e7-482d-a725-0d02293d52d0 for instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe on hv-cinder-85221 Sep 09 12:20:41.239829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e9ff0aae-95b1-465d-b150-f50125250b33 req-1ccb8b6a-edc1-4153-8289-506b9a52d9c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Sep 09 12:20:41.240416 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 429/878] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:41.321165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:41.321777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:41.327577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:41.328081 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:41.328514 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:41.329200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:41.330317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:41.331101 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:41.528026 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:41.536655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7cb13f96-6be1-4a4f-a99f-493160500e5f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1314 microversion: 2.1 time: 0.219407 Sep 09 12:20:41.537210 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 450/879] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:41 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:42.561252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:42.561949 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:42.568206 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.568689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.569122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:42.569809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.570261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.570683 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:42.700616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:42.708632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6f733969-724a-428d-bbb2-529d9b400320 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1464 microversion: 2.1 time: 0.151990 Sep 09 12:20:42.709223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 430/880] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:42 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:42.759318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:42.759823 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:42.765752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.766238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.766677 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:42.767576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.768048 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.768476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:42.793542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:20:42.867700 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-857ecdb0-8110-4962-9e9e-ca63cfac27c8 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 204 len: 0 microversion: 2.1 time: 0.111593 Sep 09 12:20:42.868182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 451/881] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:20:42 2022] DELETE /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:20:42.876329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:42.877093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:42.883218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.883833 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.884343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:42.885045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:42.885691 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:42.886183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:43.025564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:43.033757 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e00ffb75-9357-48d7-bd7e-c2a411a22c1a tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1470 microversion: 2.1 time: 0.161350 Sep 09 12:20:43.034323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 431/882] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:42 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:44.057466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:44.058155 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:44.064299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:44.064787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:44.065222 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:44.065910 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:44.066359 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:44.066785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:44.199340 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:44.207072 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0074aeab-f822-4700-a278-7ff55c963ecc tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1470 microversion: 2.1 time: 0.153789 Sep 09 12:20:44.207633 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 452/883] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:44 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:44.809157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f187fba-1e6e-4a9a-bf81-24b1944a5ffe", "name": "network-vif-deleted", "tag": "169de6c7-75e7-482d-a725-0d02293d52d0"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:20:44.818457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:44.819654 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:44.828075 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:44.828714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:44.830010 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:44.844585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] Creating event network-vif-deleted:169de6c7-75e7-482d-a725-0d02293d52d0 for instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe on hv-cinder-85221 Sep 09 12:20:44.849753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-087c8bcb-6c71-457e-b77b-2fceae3025ad req-fd88b948-3de5-4333-b6b8-12269d677634 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044990 Sep 09 12:20:44.850570 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 432/884] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:20:45.229889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:45.230497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:45.232449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:20:45.238722 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:45.239903 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:45.240339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:45.241031 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:45.241481 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:45.241895 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:45.274364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:45.274842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:45.275319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:45.275739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lazy-loading 'fault' on Instance uuid 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:20:45.321435 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0781112ec0c440da34254add94a593a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192b3c1dcb7a4d9c952420130039ea6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:20:45.328505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0c4fa201-c630-4879-b469-768a9b0fe3b1 tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 200 len: 1304 microversion: 2.1 time: 0.102493 Sep 09 12:20:45.329080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 453/885] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:45 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:20:46.352083 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:20:46.352778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] [instance: 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:20:46.359322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:46.359800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:46.360227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:46.361151 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:20:46.361606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:20:46.362029 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:20:46.375089 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] HTTP exception thrown: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Request method failure captured: Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe HTTP/1.1 Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy-QcZEl8S_xYPIDx_G-1pShUHCg43rRUNH2N1GHPwoa-94FllE5lELJX5TgkMRB_I2K-74iwUmk384unjmhynQV2Sx0pvnjxyCllrnQbD2-tfQkeG83ekev1cvKJW0hgn1fQb-ocaV_MlpgnyE5RW0NvGAgYAjkL95p3vzP4q9Ag8U Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 192b3c1dcb7a4d9c952420130039ea6c Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-1917834576 Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:20:46.377312 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/192b3c1dcb7a4d9c952420130039ea6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_192b3c1dcb7a4d9c952420130039ea6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/192b3c1dcb7a4d9c952420130039ea6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/192b3c1dcb7a4d9c952420130039ea6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-1917834576 Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 192b3c1dcb7a4d9c952420130039ea6c Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-1917834576 Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-1917834576-project Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: c0781112ec0c440da34254add94a593a Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-1917834576-project Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. Sep 09 12:20:46.379030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '2f187fba-1e6e-4a9a-bf81-24b1944a5ffe'} Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:20:46.380009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. Sep 09 12:20:46.381769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:20:46.383223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] Returning 404 to user: Instance 2f187fba-1e6e-4a9a-bf81-24b1944a5ffe could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:20:46.383223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8df5c013-0c6b-42c1-9aad-30ef10fead1f tempest-VolumesNegativeTest-1917834576 tempest-VolumesNegativeTest-1917834576-project] 10.222.0.49 "GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe" status: 404 len: 111 microversion: 2.1 time: 0.030816 Sep 09 12:20:46.383223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 433/886] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:20:46 2022] GET /compute/v2.1/servers/2f187fba-1e6e-4a9a-bf81-24b1944a5ffe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:21:00.395277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:00.396012 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:00.586241 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f6d422d5-2370-4c7f-9f80-619c6b8192dc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Action: 'create', calling method: .version_select at 0x7f6bd0da9820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1082182416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX2Mw5s2i6q0ndZ4SsJmAZQOW60zf0+oO/Tr0lFaACGwqN+wSS5GS86MYCrIBMD0OK2phcfLfSKZMLMrI7d/+zESpccCmktAj9bH/6KalS+gPYOeaW7M8hdB7AxBuc6jQ=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:00.603231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f6d422d5-2370-4c7f-9f80-619c6b8192dc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:21:00.607137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f6d422d5-2370-4c7f-9f80-619c6b8192dc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for user e2391d64c9304317bfb53e79ee0ca764 and project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:21:00.630356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f6d422d5-2370-4c7f-9f80-619c6b8192dc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.239824 Sep 09 12:21:00.631019 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 454/887] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:21:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:06.073031 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:06.073605 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:06.075818 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:06.076457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=66 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:06.083508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:06.084009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:06.084451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:06.085181 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:06.085649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:06.086069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:06.111777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8bcb8de3-0012-4da4-8572-35ba27244975 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/ips" status: 200 len: 146 microversion: 2.1 time: 0.042549 Sep 09 12:21:06.113904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 434/888] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:21:06 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:08.409218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc274bc0-d387-4656-9d59-b3cdcf266e12"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:08.411579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:08.417941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:08.418587 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:08.419076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:08.420007 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:08.420476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:08.421220 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:08.689802 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d045da44-12d8-4730-8e8d-e26ca73eb1c9 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284958 Sep 09 12:21:08.690417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 455/889] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:21:08 2022] POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:15.185752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:15.192520 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:15.193002 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:15.193443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:15.257370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Going to try to stop instance {{(pid=120593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 12:21:15.298705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8426a90f-4d15-4f26-bf14-051265286764 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action" status: 202 len: 0 microversion: 2.1 time: 0.116599 Sep 09 12:21:15.299575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 435/890] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:21:15 2022] POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:21:15.305551 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:15.309791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:15.310560 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:15.319438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:15.319870 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:15.320311 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:15.321024 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:15.321617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:15.322053 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:15.454466 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:15.462808 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ab7f5bb-59ee-4f38-945e-4d80bac99eed tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.158705 Sep 09 12:21:15.463398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 456/891] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:15 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:16.487501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:16.488252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:16.494382 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:16.494858 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:16.495315 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:16.496011 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:16.496468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:16.496894 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:16.631532 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:16.639916 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e45e68fc-3322-44dd-8858-981d48ee75b6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.157362 Sep 09 12:21:16.640485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 436/892] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:16 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:17.059926 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-553102034", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1082182416", "security_groups": [{"name": "tempest-secgroup-smoke-168402175"}], "block_device_mapping_v2": [{"uuid": "c1c4284b-3008-4c03-b8ee-0d2deddb1e99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b4dd0d4-7e37-4727-977d-26ef008eabd3"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:17.172971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] validate_networks() for [('0b4dd0d4-7e37-4727-977d-26ef008eabd3', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:21:17.572731 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:21:17.573157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:21:17.573630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:21:17.574038 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:21:17.574448 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:21:17.583611 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:17.584088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:17.584517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:17.585242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:17.585692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:17.586113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:17.603747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:21:17.607681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for user e2391d64c9304317bfb53e79ee0ca764 and project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:21:17.662561 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:17.663193 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:17.664730 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:21:17.666893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c4284b-3008-4c03-b8ee-0d2deddb1e99',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:21:17.669534 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:17.670014 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:17.670758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:17.672008 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:17.672463 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:17.672990 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:17.804993 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [a4d7c0fc-cf0d-4b07-bc2c-7fe6104cca90] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:21:17.815609 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:17.823674 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3b3adfc-9ff2-44a0-b50c-28d8f5be2497 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.164861 Sep 09 12:21:17.824233 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 437/893] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:17 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:18.811831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [a4d7c0fc-cf0d-4b07-bc2c-7fe6104cca90] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 53444. Sep 09 12:21:18.815523 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-21d1fa45-a6e4-4556-b21f-997ee41c7742 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.759475 Sep 09 12:21:18.816172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 457/894] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:21:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:21:18.827170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-784df5d9-6f71-44f5-9870-2ba83ffecb44 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:18.827884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-784df5d9-6f71-44f5-9870-2ba83ffecb44 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:18.853323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:18.854123 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:18.861307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:18.861707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:18.862152 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:18.862861 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:18.863418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:18.864015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:18.884101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-784df5d9-6f71-44f5-9870-2ba83ffecb44 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:18.891798 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-784df5d9-6f71-44f5-9870-2ba83ffecb44 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1094 microversion: 2.1 time: 0.068523 Sep 09 12:21:18.892570 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 438/895] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:18 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:19.006348 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:19.015590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ac861396-cf94-45a1-b43e-a8b9690c4e9d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.166171 Sep 09 12:21:19.016160 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 458/896] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:18 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:19.915220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:19.915888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:19.924219 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:19.924708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:19.925149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:19.925979 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:19.926482 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:19.926933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:19.990214 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:19.998320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6040dd90-5593-4360-9e29-81ae98f79750 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1192 microversion: 2.1 time: 0.087081 Sep 09 12:21:20.000203 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 439/897] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:19 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:20.042076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:20.042675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:20.051272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:20.052129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:20.052574 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:20.053350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:20.053814 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:20.054243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:20.270582 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:20.279088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-84d42e11-8dfb-4ae3-a9cf-2bb1cc279404 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.241231 Sep 09 12:21:20.279662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 459/898] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:20 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:21.022827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:21.023526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:21.031340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:21.031830 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:21.032274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:21.032995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:21.033456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:21.033884 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:21.303673 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:21.304289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:21.310794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:21.311301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:21.311884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:21.312586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:21.313052 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:21.313526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:21.539146 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:21.547750 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dce64314-bff7-4001-bd7d-0dda591d3bd7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.528661 Sep 09 12:21:21.548248 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 440/899] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:21 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:21.592728 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:21.601166 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f65ae120-dd38-422d-8989-01144b05d30f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.301316 Sep 09 12:21:21.601744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 460/900] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:21 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:21.988433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f09e41f-24fb-4542-8243-81c8206f2198", "tag": "374278be-7783-4ddd-af17-47d19aa2566a"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:21.998689 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:21.999634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:22.000080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:22.012311 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] Creating event network-changed:374278be-7783-4ddd-af17-47d19aa2566a for instance 8f09e41f-24fb-4542-8243-81c8206f2198 on hv-cinder-85221 Sep 09 12:21:22.017496 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-a649d43c-fb3c-483c-96c7-71ec0c0be76d req-f5c6d137-bcf2-44f7-a954-7dd20ba66e67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033199 Sep 09 12:21:22.018085 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 441/901] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:22.572143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:22.572749 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:22.579428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:22.579908 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:22.580346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:22.581033 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:22.581486 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:22.581914 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:22.626589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:22.627268 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:22.633637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:22.634187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:22.634623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:22.635540 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:22.635998 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:22.636421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:22.852688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:22.860344 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dd3fe282-f467-4c74-bcc7-e9203bd600f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.292076 Sep 09 12:21:22.860909 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 461/902] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:22 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:22.925576 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:22.933975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b31dfda9-bb91-4fa7-be3b-f47d9ac1cf5f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.312522 Sep 09 12:21:22.934546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 442/903] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:22 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:23.883418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:23.884027 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:23.890552 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:23.891082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:23.891521 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:23.892205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:23.892656 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:23.893076 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:23.957907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:23.958426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:23.964708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:23.965184 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:23.965612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:23.966287 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:23.966730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:23.967700 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:24.056668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:24.064857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d6b89d1a-63fa-4ad1-8898-22bf427be93e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.185271 Sep 09 12:21:24.065646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 462/904] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:23 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:24.116522 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:24.125123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ca39edd6-da1d-47ee-847c-165814330cbd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.171158 Sep 09 12:21:24.125682 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 443/905] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:23 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:25.087473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:25.088084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:25.094384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:25.094860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:25.095335 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:25.096015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:25.096465 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:25.096880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:25.149069 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:25.149802 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:25.156623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:25.157191 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:25.157636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:25.158334 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:25.158793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:25.159255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:25.273060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:25.285146 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-aaad76d0-5e22-48ea-9ab4-b29d3ff81393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.201386 Sep 09 12:21:25.285744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 463/906] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:25 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:25.317787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:25.326038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eade9e5b-a4aa-430e-a72b-0eb517017e60 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.180871 Sep 09 12:21:25.326642 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 444/907] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:25 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:26.308893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:26.309504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:26.316550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:26.317037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:26.317476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:26.318172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:26.318631 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:26.319098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:26.348956 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:26.349664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:26.356249 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:26.356739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:26.357222 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:26.358710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:26.359190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:26.359616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:26.503218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:26.510820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7cf22553-ba48-43f7-9010-2080b04e80ea tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.205764 Sep 09 12:21:26.511424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 464/908] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:26 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:26.528358 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:26.536826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-98812a69-d897-4f65-b721-5112b246c82d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.191767 Sep 09 12:21:26.537386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 445/909] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:26 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:27.533912 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:27.534464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:27.540797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:27.541277 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:27.541706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:27.542383 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:27.542836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:27.543280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:27.562112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:27.562720 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:27.569112 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:27.569602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:27.570038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:27.570729 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:27.571306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:27.571727 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:27.594710 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:27.614307 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:27.729218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:27.737951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-49150698-d140-4042-b987-ca37bfdc155d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.208087 Sep 09 12:21:27.741576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 465/910] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:27 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:27.759121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:27.764906 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b5f48548-263e-42de-aff5-4301d611a8de tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.207143 Sep 09 12:21:27.765890 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 446/911] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:27 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:28.763982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:28.764583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:28.771586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:28.772069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:28.772519 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:28.773198 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:28.773647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:28.774071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:28.788152 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:28.788765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:28.795148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:28.795634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:28.796072 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:28.796952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:28.797242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:28.797667 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:28.888900 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:28.976599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:28.983082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:28.984675 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-35e3a4da-dfc4-46b3-a900-185def574ecb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.224739 Sep 09 12:21:28.985289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 466/912] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:28 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:28.991729 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ba9ad1c2-1ef1-4d00-adfb-5298aa70f554 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.207367 Sep 09 12:21:28.992284 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 447/913] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:28 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:30.008507 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:30.009074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:30.016421 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:30.016893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:30.017324 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:30.017463 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:30.017579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:30.018163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:30.018623 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:30.019097 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:30.023913 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:30.024392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:30.024828 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:30.025513 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:30.025962 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:30.026380 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:30.217305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:30.220213 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:30.225527 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6757bba6-e9bc-44fc-a63e-2dd7c0669f92 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.221110 Sep 09 12:21:30.226262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 467/914] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:30 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:30.228673 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-87dde751-c754-49f5-9a17-2bf1f843a608 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.216644 Sep 09 12:21:30.229263 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 448/915] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:30 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:31.248701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:31.249371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:31.252299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:31.252450 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:31.253009 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:31.258288 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:31.258782 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:31.259254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:31.259772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:31.259956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:31.260354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:31.260473 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:31.260845 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:31.260947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:31.261586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:31.262044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:31.262470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:31.268414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:31.462128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:31.473497 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:31.477390 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e962308a-7d47-44da-be77-dcf5c93d79fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.232472 Sep 09 12:21:31.478187 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 468/916] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:31 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:31.482608 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aef0af79-6c82-4f73-a30a-3f7ba7baa3dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.234502 Sep 09 12:21:31.484397 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 449/917] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:31 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:31.488770 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f09e41f-24fb-4542-8243-81c8206f2198", "name": "network-vif-plugged", "status": "completed", "tag": "374278be-7783-4ddd-af17-47d19aa2566a"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:31.498660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:31.499172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:31.500178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:31.511215 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] Creating event network-vif-plugged:374278be-7783-4ddd-af17-47d19aa2566a for instance 8f09e41f-24fb-4542-8243-81c8206f2198 on hv-cinder-85221 Sep 09 12:21:31.516624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-ad6b632f-dfe7-4dde-827e-0455bead7c81 req-a372f00c-5239-4656-a921-a9369e1e1ee9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032376 Sep 09 12:21:31.517236 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 469/918] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:32.500698 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:32.501351 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:32.507729 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:32.508259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:32.508703 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:32.509229 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:32.509688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:32.509877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:32.509991 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:32.510449 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:32.516690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:32.517178 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:32.517615 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:32.518347 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:32.518860 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:32.519318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:32.711682 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:32.714884 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:32.720788 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-df7ade56-7d32-4c91-bb52-4d0144cbcc50 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1265 microversion: 2.1 time: 0.224276 Sep 09 12:21:32.721943 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 450/919] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:32 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:32.731957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-364724d5-fc33-4106-999a-a1e041dda7a4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.227741 Sep 09 12:21:32.732637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 470/920] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:32 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:33.743220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:33.743831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:33.750347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.751045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.751486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:33.752185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.752640 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.753065 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:33.755987 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:33.756602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:33.762979 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.763482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.763954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:33.764652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.765110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.765557 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:33.773080 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:33.949874 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:33.954739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:33.958709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0cbc4333-acb2-4342-b5f8-a979d925e913 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1453 microversion: 2.1 time: 0.219288 Sep 09 12:21:33.959319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 451/921] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:33 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:33.962933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-654d78fd-c247-415c-882c-10ef579195fe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.210915 Sep 09 12:21:33.963489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 471/922] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:33 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:21:33.981354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:33.981984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:33.987857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.988339 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.988772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:33.989456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:33.989907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:33.990331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:34.122299 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:34.130068 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b59130fa-2862-40a9-8013-54f57e147454 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1453 microversion: 2.1 time: 0.152373 Sep 09 12:21:34.130647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 452/923] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:33 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:34.990075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:34.990634 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:34.999046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:34.999569 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:35.000522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:35.001428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:35.001890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:35.002317 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:35.250077 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:35.261015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d6b04d46-1455-46cb-896e-ee0fed9c788d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1723 microversion: 2.1 time: 0.274734 Sep 09 12:21:35.261766 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 472/924] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:34 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:36.290983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f09e41f-24fb-4542-8243-81c8206f2198", "tag": "374278be-7783-4ddd-af17-47d19aa2566a"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:36.296240 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:36.297058 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:36.301267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=41 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:21:36.306438 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.307321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.307960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.308790 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.309345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.309455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.309941 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.310055 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.310374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.324037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] Creating event network-changed:374278be-7783-4ddd-af17-47d19aa2566a for instance 8f09e41f-24fb-4542-8243-81c8206f2198 on hv-cinder-85221 Sep 09 12:21:36.330606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-db35ffb2-82e3-4c80-b258-0920ed4b5ad3 req-bce8ca02-20ae-4c6e-bee5-0cb1fe8cbafe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042386 Sep 09 12:21:36.331021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 473/925] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:21:36.534369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:36.542847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7914117f-615a-4e27-827b-c09deeead81f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1700 microversion: 2.1 time: 0.259406 Sep 09 12:21:36.543784 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 453/926] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:36 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1700 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:36.567590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:21:36.574167 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.574970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.575525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.643568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Going to try to start instance {{(pid=120591) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 12:21:36.693204 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-95c14dab-d082-4f6b-8e0a-80025056c94a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action" status: 202 len: 0 microversion: 2.1 time: 0.129597 Sep 09 12:21:36.693986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 474/927] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:21:36 2022] POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:21:36.704491 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:36.710975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:36.720719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.724095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.724612 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.725452 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:36.725926 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:36.726359 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:36.976310 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:36.985989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f36cd601-4c9b-4d61-8624-3b346efb0a70 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1709 microversion: 2.1 time: 0.287313 Sep 09 12:21:36.986767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 454/928] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:36 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1709 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:38.010508 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:38.011244 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:38.018242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:38.018733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:38.019197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:38.019893 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:38.020360 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:38.020789 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:38.148110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:38.156609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-173a4ce1-c684-4a5b-9347-81ff058a60dd tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1709 microversion: 2.1 time: 0.151087 Sep 09 12:21:38.157176 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 475/929] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:38 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:21:39.180859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:21:39.181470 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:21:39.188284 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:39.188771 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:39.189239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:39.189933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:21:39.190435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:21:39.190840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:21:39.325186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:21:39.334027 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3038a3aa-18f4-4e7a-9cb5-636ad7204446 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1713 microversion: 2.1 time: 0.157022 Sep 09 12:21:39.334604 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 455/930] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:21:39 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:12.168329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:12.168918 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:12.171044 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=15 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:12.171709 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:12.177746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:12.178260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:12.178698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:12.179417 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:12.179902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:12.180327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:12.260763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lazy-loading 'services' on Instance uuid 92414745-4f7c-41ec-bcec-e2d6736c9786 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:22:12.332104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7adbfeaf-f96d-42db-8c28-5ca209db0bcf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments/cc274bc0-d387-4656-9d59-b3cdcf266e12" status: 202 len: 0 microversion: 2.1 time: 0.167764 Sep 09 12:22:12.332950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 476/931] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:22:12 2022] DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments/cc274bc0-d387-4656-9d59-b3cdcf266e12 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:22:13.457000 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:13.459178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=5 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:13.459832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=26 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:13.465531 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:13.466019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:13.466451 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:13.637679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Going to try to stop instance {{(pid=120593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 12:22:13.679750 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-35689a58-da06-4f06-89fd-710a0865f89c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action" status: 202 len: 0 microversion: 2.1 time: 0.226581 Sep 09 12:22:13.680346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 456/932] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:22:13 2022] POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:22:13.689749 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:13.690540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:13.697362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:13.697999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:13.698516 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:13.699330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:13.699885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:13.700322 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:13.831407 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:13.839113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-30c89c00-15c7-4532-95ff-af1becc43e51 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.154092 Sep 09 12:22:13.839676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 477/933] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:13 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:14.864099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:14.864793 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:14.870987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:14.871474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:14.871908 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:14.872601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:14.873050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:14.873474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.005501 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:15.013303 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-738fb881-d993-4a5a-a9c7-014a5b2a64e8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.154589 Sep 09 12:22:15.013859 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 457/934] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:14 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:16.037947 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:16.038564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:16.044944 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:16.045428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:16.045865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:16.046550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:16.047323 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:16.047758 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:16.177894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:16.185544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c52b71e0-bf5b-4f01-b2b3-1ebab14853c4 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.151430 Sep 09 12:22:16.186107 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 478/935] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:16 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:22:17.209187 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:17.209796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:17.216081 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:17.216668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:17.217165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:17.218066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:17.218693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:17.219238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:17.350601 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:17.358251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6716a7bc-6389-4415-96e9-745d66376c54 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.152968 Sep 09 12:22:17.358811 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 458/936] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:17 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:18.382780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:18.383463 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:18.389778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:18.390268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:18.390702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:18.392262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:18.392720 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:18.393144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:18.519565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:18.527182 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4b20a2db-7fcf-44a8-971c-8f7d0faa3715 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.148265 Sep 09 12:22:18.527752 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 479/937] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:18 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:19.551345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:19.552038 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:19.558445 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:19.558952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:19.559384 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:19.560066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:19.560516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:19.560933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:19.689310 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:19.697227 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-01c46170-585e-41bc-920b-125d17e24c62 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.150754 Sep 09 12:22:19.697787 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 459/938] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:19 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:20.720612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:20.721247 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:20.727638 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:20.728121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:20.728555 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:20.729250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:20.729702 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:20.730125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:20.861215 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:20.868843 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-17d83817-74fc-4356-95cd-d398397d6d0c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.152176 Sep 09 12:22:20.869413 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 480/939] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:20 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:21.892975 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:21.893575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:21.900245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:21.900678 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:21.901108 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:21.901794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:21.902244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:21.902668 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:22.030096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:22.039606 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50bb687b-727d-452a-a6ad-1341c12d565f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.151186 Sep 09 12:22:22.040157 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 460/940] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:21 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:22:23.063016 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:23.063556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:23.069886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:23.070371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:23.070826 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:23.071526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:23.071977 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:23.072400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:23.204018 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:23.211598 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-21fee81f-e87d-4ac1-aa7a-fb352f5ab81b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1677 microversion: 2.1 time: 0.152867 Sep 09 12:22:23.212157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 481/941] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:23 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:24.236243 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:24.236856 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:24.243841 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.244323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.244752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.245437 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.245888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.246305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.377267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:24.384983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-46a9c640-58a3-4271-a702-162da0e7c88f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1654 microversion: 2.1 time: 0.153461 Sep 09 12:22:24.385538 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 461/942] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:24 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:24.408037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:24.414630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.415200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.415649 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.440358 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Going to try to start instance {{(pid=120591) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 12:22:24.481904 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-606e50ab-1b44-49e9-a2eb-c3e4c582ebb0 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action" status: 202 len: 0 microversion: 2.1 time: 0.077529 Sep 09 12:22:24.482493 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 482/943] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Sep 9 12:22:24 2022] POST /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:22:24.491177 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:24.491852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:24.498096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.498690 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.499297 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.500509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.501113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.501644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.634631 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:24.643831 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0ef9b38d-64dc-4376-ba49-c21a7a608d0e tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1663 microversion: 2.1 time: 0.156943 Sep 09 12:22:24.650453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 462/944] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:24 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:25.668071 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:25.668798 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:25.675350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:25.675840 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:25.676285 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:25.676980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:25.677438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:25.677867 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:25.812261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:25.819992 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-186d9840-4514-4bd1-984d-392625e1918a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1663 microversion: 2.1 time: 0.156655 Sep 09 12:22:25.820566 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 483/945] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:25 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:26.849664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:26.850272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:26.856714 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:26.857196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:26.857632 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:26.858322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:26.858773 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:26.859808 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:26.988930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:26.996655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-97f89f18-9db1-46cb-a204-db733bc147d6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1667 microversion: 2.1 time: 0.150934 Sep 09 12:22:26.997217 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 463/946] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:26 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:22:59.126489 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:59.128792 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:59.130963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=16 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:59.131744 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:59.137470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.138001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.138563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.139298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.139760 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.140189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.170950 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eb9ce4dd-5dcc-4dad-b5f7-8fe0fc936282 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048523 Sep 09 12:22:59.171511 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 484/947] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:22:59 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:22:59.235253 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:59.235772 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:59.238084 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=16 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:59.238800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:59.244252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.244743 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.245182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.245872 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.246331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.246758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.273299 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:22:59.348892 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e18581c0-7661-4b3a-a40c-7ad0f407fabb tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 204 len: 0 microversion: 2.1 time: 0.117793 Sep 09 12:22:59.349432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 464/948] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:22:59 2022] DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:22:59.358177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:59.359125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:59.365046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.365531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.365970 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.366655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:59.367154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:59.367578 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:59.550591 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:59.558431 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-abfa49b7-5b30-4cbd-9ee6-6e629a2fb746 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1673 microversion: 2.1 time: 0.204379 Sep 09 12:22:59.559041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 485/949] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:59 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:00.582929 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:00.583552 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:00.589862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:00.590337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:00.590766 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:00.592256 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:00.592710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:00.593131 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:00.772596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:00.780573 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f24f3d46-9a3e-4eba-86a1-604b15fae536 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1673 microversion: 2.1 time: 0.201893 Sep 09 12:23:00.781132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 465/950] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:00 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:01.804869 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:01.805482 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:01.812374 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:01.812887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:01.813354 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:01.814054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:01.814509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:01.814965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:01.950432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:01.958717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a0696d5-1f91-4449-ba6b-3687150e48d2 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 200 len: 1673 microversion: 2.1 time: 0.157721 Sep 09 12:23:01.959887 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 486/951] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:01 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:02.250239 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92414745-4f7c-41ec-bcec-e2d6736c9786", "name": "network-vif-deleted", "tag": "800902ce-8946-4c3d-bb11-c2f5a3c30da2"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:02.264444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:02.264914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:02.265551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:02.280467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] Creating event network-vif-deleted:800902ce-8946-4c3d-bb11-c2f5a3c30da2 for instance 92414745-4f7c-41ec-bcec-e2d6736c9786 on hv-cinder-85221 Sep 09 12:23:02.286599 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-dad95960-0df8-4f94-8df7-a3f1e82d2f34 req-52dbc422-bfe9-463f-85f4-aab61a1f4ffd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039576 Sep 09 12:23:02.288122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 466/952] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:02.983899 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:02.984518 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:02.990839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:02.991384 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:02.991815 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:02.992505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:02.992953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:02.993371 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:03.007266 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 HTTP/1.1 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:23:03.008901 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:23:03.010453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '92414745-4f7c-41ec-bcec-e2d6736c9786'} Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:23:03.011349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:23:03.012859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:23:03.014216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:23:03.014216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0679b867-209b-47d5-a4a3-6c2496e71954 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 404 len: 111 microversion: 2.1 time: 0.030834 Sep 09 12:23:03.014216 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 487/953] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:02 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:23:03.019943 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6792124f-854e-4974-8962-38b000a5c62b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '.version_select at 0x7f6bd0c6e310>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:03.024476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6792124f-854e-4974-8962-38b000a5c62b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [e5eb4547-399f-424f-8004-61080e178d6b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:23:04.032359 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [None req-6792124f-854e-4974-8962-38b000a5c62b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [e5eb4547-399f-424f-8004-61080e178d6b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 53632. Sep 09 12:23:04.050492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6792124f-854e-4974-8962-38b000a5c62b tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-206483036" status: 202 len: 0 microversion: 2.1 time: 1.034757 Sep 09 12:23:04.051305 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 467/954] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Sep 9 12:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-206483036 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:23:04.657883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b8615487-a0d5-4707-9066-946e9f4e17dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: .version_select at 0x7f6bd0a78af0>, body: {"keypair": {"name": "tempest-keypair-4395205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqjrlLQ2Hn7d0ADbC8vmTdm6EzlQ7GN+Eng2GgpY3TxGU6fEJEOrxrZVpO8CmZFkJxQDZ7PRap9lIKmk0vktZz10iVBeN6FxMhNU5bbtwIyPurw1h3r3nB3cLvPNmP4Ag=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:04.674061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-b8615487-a0d5-4707-9066-946e9f4e17dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:23:04.677727 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-b8615487-a0d5-4707-9066-946e9f4e17dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for user 870f5366f958496d93c51e4b573e2487 and project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:23:04.698999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b8615487-a0d5-4707-9066-946e9f4e17dc tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.045120 Sep 09 12:23:04.699577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 488/955] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Sep 9 12:23:04 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:05.944664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-320418837", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5aabc735-25cb-4def-82b4-34d6ed0ea6a0"}], "security_groups": [{"name": "tempest-securitygroup--918532582"}], "key_name": "tempest-keypair-4395205", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:06.051141 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] validate_networks() for [('5aabc735-25cb-4def-82b4-34d6ed0ea6a0', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:23:06.425590 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:23:06.426039 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:23:06.426509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:23:06.426943 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:23:06.427384 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:23:06.436778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:06.437253 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:06.437688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:06.438411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:06.438862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:06.439309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:06.457093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:23:06.460995 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Getting quotas for user 870f5366f958496d93c51e4b573e2487 and project 69e19a94fd744d9e94d9f5ff5b089f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:23:06.471812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:23:06.474156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:23:06.519364 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [4f30a83e-a3c3-439f-b622-531140a1c936] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:23:07.526533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [4f30a83e-a3c3-439f-b622-531140a1c936] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 53666. Sep 09 12:23:07.530546 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-233bbce8-0346-45b2-bf30-f1e8713bba84 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.590660 Sep 09 12:23:07.531230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 468/956] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:23:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:23:07.543037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0d0478a0-f02f-4fb3-87b5-65d6f28c9a72 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:07.544145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0d0478a0-f02f-4fb3-87b5-65d6f28c9a72 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:07.600801 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0d0478a0-f02f-4fb3-87b5-65d6f28c9a72 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:07.608264 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0d0478a0-f02f-4fb3-87b5-65d6f28c9a72 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1234 microversion: 2.1 time: 0.069528 Sep 09 12:23:07.608832 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 489/957] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:07 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1234 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:08.632953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:08.633659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:08.642077 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:08.642846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:08.643487 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:08.644362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:08.644994 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:08.645425 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:08.715094 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:08.722796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4f68ba68-87a1-4137-b126-3af8a53d23e5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1292 microversion: 2.1 time: 0.094906 Sep 09 12:23:08.723443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 469/958] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:08 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:09.746832 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:09.747890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:09.755161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:09.755351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:09.755985 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:09.756679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:09.757129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:09.757549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:09.891106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:09.899119 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e55e7205-acbf-4aa5-8f55-e9a01cfb774f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1359 microversion: 2.1 time: 0.156724 Sep 09 12:23:09.899685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 490/959] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:09 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:09.955386 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56", "tag": "bf97cadb-f29e-43e0-b30e-987145da1d2c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:09.966323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:09.966820 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:09.967283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:09.979024 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] Creating event network-changed:bf97cadb-f29e-43e0-b30e-987145da1d2c for instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 on hv-cinder-85221 Sep 09 12:23:09.984704 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ac1a82f1-7524-4138-91f7-415a034bc243 req-4ce12404-236e-4bec-9962-d7c0ccc595c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033880 Sep 09 12:23:09.985301 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 470/960] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:10.922436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:10.922997 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:10.929367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:10.929854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:10.930292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:10.931006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:10.931464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:10.931917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:11.062401 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:11.070213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ed2a6fe8-513a-43b9-bd77-af64c70b9fbe tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1359 microversion: 2.1 time: 0.151981 Sep 09 12:23:11.076069 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 491/961] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:10 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:12.095310 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:12.095934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:12.102150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:12.102634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:12.103101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:12.103823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:12.104280 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:12.104709 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:12.237725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:12.245549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b96fae71-27cb-42cd-985f-58eda59e5aaa tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1359 microversion: 2.1 time: 0.155611 Sep 09 12:23:12.246138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 471/962] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:12 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:13.269306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:13.269917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:13.276292 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:13.276775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:13.277205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:13.278460 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:13.279130 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:13.279556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:13.406771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:13.414451 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bfb3cf95-cd54-4d2c-a27d-8ffd4b0a25cf tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1359 microversion: 2.1 time: 0.149078 Sep 09 12:23:13.415029 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 492/963] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:13 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:13.997951 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56", "name": "network-vif-plugged", "status": "completed", "tag": "bf97cadb-f29e-43e0-b30e-987145da1d2c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:14.008664 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:14.009130 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:14.009564 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:14.021354 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] Creating event network-vif-plugged:bf97cadb-f29e-43e0-b30e-987145da1d2c for instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 on hv-cinder-85221 Sep 09 12:23:14.026082 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-254ffae6-fdf9-4483-92d7-99788d82d5d7 req-2abffa3a-7f39-41c5-9f5f-b37088549d61 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032445 Sep 09 12:23:14.026674 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 472/964] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:14.438525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:14.439168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:14.445524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:14.446006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:14.446443 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:14.447156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:14.447614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:14.448037 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:14.578599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:14.586249 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1c4d8deb-395a-4396-bdc2-7d3858c9909f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1359 microversion: 2.1 time: 0.152423 Sep 09 12:23:14.586816 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 493/965] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:14 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:15.611309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:15.612016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:15.618156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:15.618637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:15.619105 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:15.619795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:15.620251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:15.620681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:15.755866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:15.763837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-986ce1ca-db71-4519-ad46-1bd2f5f3058f tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1545 microversion: 2.1 time: 0.157873 Sep 09 12:23:15.764405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 473/966] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:15 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:15.785804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:15.786305 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:15.792686 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:15.793674 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:15.794115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:15.794807 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:15.795669 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:15.796103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:15.873316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cc3081de-cecc-4736-9525-4bd125869529 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091276 Sep 09 12:23:15.873921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 494/967] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Sep 9 12:23:15 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:16.796906 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56", "tag": "bf97cadb-f29e-43e0-b30e-987145da1d2c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:16.802566 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:16.803435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:16.809769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:16.810247 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:16.810678 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:16.821730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] Creating event network-changed:bf97cadb-f29e-43e0-b30e-987145da1d2c for instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 on hv-cinder-85221 Sep 09 12:23:16.827148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-2cd64533-5f84-4f6f-8570-0f1f14ac7551 req-b2a68e17-f920-419e-af12-604737ca5f36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Sep 09 12:23:16.827739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 474/968] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:31.614930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.616142 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.616836 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=48 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.621320 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:31.622444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:31.630692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:31.631200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:31.631662 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:31.632353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:31.632803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:31.633223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:31.813868 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:23:31.887172 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ebf9a79b-a482-44c6-b442-c0e7a9dd3ab9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 204 len: 0 microversion: 2.1 time: 0.273935 Sep 09 12:23:31.888082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 495/969] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:23:31 2022] DELETE /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:23:31.894320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.895324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:31.899856 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:31.900547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:31.909018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:31.909503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:31.909930 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:31.910614 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:31.911092 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:31.911521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:32.296258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:32.304060 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-84825d85-63ae-4550-8601-3af23ed1c864 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1577 microversion: 2.1 time: 0.411538 Sep 09 12:23:32.304625 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 475/970] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:31 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1577 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:23:33.328116 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:33.328818 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:33.335200 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:33.335685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:33.336121 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:33.336812 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:33.337265 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:33.337688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:33.468583 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:33.476367 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-971ec1e8-eda6-4254-bd1e-89b3fab38658 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1577 microversion: 2.1 time: 0.152730 Sep 09 12:23:33.476934 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 496/971] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:33 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:34.339125 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f09e41f-24fb-4542-8243-81c8206f2198", "name": "network-vif-deleted", "tag": "374278be-7783-4ddd-af17-47d19aa2566a"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:34.351589 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:34.351987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:34.352474 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:34.366039 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] Creating event network-vif-deleted:374278be-7783-4ddd-af17-47d19aa2566a for instance 8f09e41f-24fb-4542-8243-81c8206f2198 on hv-cinder-85221 Sep 09 12:23:34.376021 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ba4315c7-96bd-4cb4-9292-9400a6fc3a3d req-89a1fbd8-f2ec-4035-8605-5d58482d8802 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113002 Sep 09 12:23:34.376851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 476/972] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:34.500679 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:34.501558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:34.507885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:34.508645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:34.509256 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:34.510125 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:34.510742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:34.511369 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:34.580761 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:34.588811 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-479b9c83-e2dc-4f9b-8d5e-b68dd3c7b952 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 200 len: 1225 microversion: 2.1 time: 0.092133 Sep 09 12:23:34.599350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 497/973] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:34 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:35.616581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:35.617274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:35.623476 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:35.623952 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:35.624376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:35.625063 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:35.625518 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:35.625940 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:35.639388 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] HTTP exception thrown: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Request method failure captured: Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 HTTP/1.1 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy-nfsefQFyIpYyV7TvZQfDQadwe1yDFqSs9sR-KF-_aOF52JgDhutu-vqr1bvGpt3qnVqUtnF1x8430jC-SrxWh9z_In21-mJSQCkxns_fcbvLfDhDR-1fAinhlFG1VjhaIIbfe67AUjq1rwSEU3Ldwmp_OPsuw83NXuLwIFVKpDhs Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:23:35.641030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-874492032 Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: e2391d64c9304317bfb53e79ee0ca764 Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:23:35.642716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '8f09e41f-24fb-4542-8243-81c8206f2198'} Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:23:35.643909 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:23:35.645508 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:23:35.646961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Returning 404 to user: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:23:35.646961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2913d438-dbaf-45c5-860f-a49d73ee3993 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 404 len: 111 microversion: 2.1 time: 0.030549 Sep 09 12:23:35.646961 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 477/974] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:35 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:23:35.692157 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1758958167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1082182416", "security_groups": [{"name": "tempest-secgroup-smoke-168402175"}], "block_device_mapping_v2": [{"uuid": "c1c4284b-3008-4c03-b8ee-0d2deddb1e99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b4dd0d4-7e37-4727-977d-26ef008eabd3"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:35.808842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] validate_networks() for [('0b4dd0d4-7e37-4727-977d-26ef008eabd3', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:23:36.227829 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:23:36.228243 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:23:36.228707 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:23:36.229106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:23:36.229509 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:23:36.238408 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:36.238813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:36.239270 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:36.239983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:36.240426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:36.240842 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:36.257293 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:23:36.261165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for user e2391d64c9304317bfb53e79ee0ca764 and project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:23:36.317449 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:23:36.319659 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c4284b-3008-4c03-b8ee-0d2deddb1e99',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:23:36.446388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-69dbb356-3fce-48be-abe1-3f1f7d9c307d tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758020 Sep 09 12:23:36.447054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 498/975] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:23:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:23:36.458885 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-246f2c39-53b3-46ce-9abe-3232b83a6257 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:36.459533 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-246f2c39-53b3-46ce-9abe-3232b83a6257 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:36.514436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-246f2c39-53b3-46ce-9abe-3232b83a6257 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:36.521315 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-246f2c39-53b3-46ce-9abe-3232b83a6257 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1095 microversion: 2.1 time: 0.066320 Sep 09 12:23:36.521877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 478/976] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:36 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:37.543788 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:37.544438 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:37.551443 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:37.551943 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:37.552382 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:37.553093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:37.553553 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:37.553980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:37.618681 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:37.629339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf09cebf-cd0c-4bb5-bf99-a09ece126452 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1211 microversion: 2.1 time: 0.087650 Sep 09 12:23:37.635047 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 499/977] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:37 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:38.650778 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:38.651356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:38.661057 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:38.661592 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:38.662110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:38.662880 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:38.663363 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:38.663782 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:38.803384 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:38.811907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7b18512e-817f-4091-8626-8f40219039c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.166024 Sep 09 12:23:38.812480 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 479/978] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:38 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:39.080084 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52fdd8f-1d71-4ae3-9548-a7ca99df88f9", "tag": "990bb37e-8d61-4f15-8bcf-815b5ac9368e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:39.093718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:39.094361 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:39.095015 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:39.108321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] Creating event network-changed:990bb37e-8d61-4f15-8bcf-815b5ac9368e for instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 on hv-cinder-85221 Sep 09 12:23:39.113726 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-4ead5b64-5b4a-491c-a396-bf364affa9d9 req-33565155-4765-47b1-ab7a-d3842aeb3c1a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 Sep 09 12:23:39.114324 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 500/979] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:39.835672 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:39.836399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:39.844208 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:39.844712 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:39.845156 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:39.845871 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:39.846333 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:39.846765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:39.982196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:39.990215 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d0fa7dbf-3ae4-4dab-8582-f8a4e8dc956b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.158450 Sep 09 12:23:39.990888 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 480/980] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:39 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:41.013617 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:41.014346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:41.020984 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:41.021470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:41.021911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:41.022606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:41.023096 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:41.023525 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:41.159240 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:41.166862 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-45389847-e489-4238-a6cc-b9bf6e240438 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.157659 Sep 09 12:23:41.167452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 501/981] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:41 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:42.190769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:42.191403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:42.197991 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:42.198479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:42.198938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:42.199686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:42.200321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:42.200762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:42.331113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:42.338656 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-df730930-6e84-4354-9e50-2b5e0a3fb1e9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.151885 Sep 09 12:23:42.339245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 481/982] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:42 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:43.362461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:43.363091 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:43.369483 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:43.369963 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:43.370394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:43.371128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:43.372104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:43.372772 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:43.503690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:43.511329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-66bd22cd-5912-43a2-ab9b-a6c086235d21 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.152704 Sep 09 12:23:43.511886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 502/983] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:43 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:44.535102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:44.535705 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:44.542093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:44.542570 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:44.543035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:44.543837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:44.544295 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:44.544719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:44.678272 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:44.686515 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-36d147b3-3702-4d51-9ba0-c9fe6f5f96cc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.155324 Sep 09 12:23:44.687118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 482/984] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:44 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:45.709551 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:45.710156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:45.717274 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:45.717754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:45.718183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:45.718863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:45.719339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:45.719758 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:45.855495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:45.863166 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-61567519-ba96-40e2-9696-06c4efc7d482 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.157408 Sep 09 12:23:45.863725 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 503/985] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:45 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:46.886502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:46.887093 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:46.889840 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:46.895399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:46.895889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:46.896367 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:46.897062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:46.897551 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:46.897983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:47.031195 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:47.038852 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7a966eb6-196e-499a-8a14-2a5a9b8071b7 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.156295 Sep 09 12:23:47.039440 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 483/986] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:46 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:48.061590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:48.062199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:48.064158 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:48.064852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:48.071446 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:48.071982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:48.072418 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:48.073113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:48.073570 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:48.073989 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:48.204529 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52fdd8f-1d71-4ae3-9548-a7ca99df88f9", "name": "network-vif-plugged", "status": "completed", "tag": "990bb37e-8d61-4f15-8bcf-815b5ac9368e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:48.217898 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:48.222407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:48.222889 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:48.223353 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:48.226404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0b68ce90-ccbd-41d1-ae26-0a750c6b7522 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.168694 Sep 09 12:23:48.227006 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 504/987] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:48 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:48.234740 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] Creating event network-vif-plugged:990bb37e-8d61-4f15-8bcf-815b5ac9368e for instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 on hv-cinder-85221 Sep 09 12:23:48.240171 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-edbc6354-3e81-4f0a-9936-a48939168d77 req-9170c2c9-063b-4179-be50-9ee3445f7589 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107235 Sep 09 12:23:48.240905 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 484/988] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:23:49.249844 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:49.250469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:49.256960 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:49.257455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:49.257899 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:49.258599 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:49.259091 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:49.259532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:49.392703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:49.400471 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2419a69f-c85a-498f-abcc-c6d160d3e9f4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1266 microversion: 2.1 time: 0.155434 Sep 09 12:23:49.401041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 505/989] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:49 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:50.424460 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:50.425149 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:50.431774 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:50.432251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:50.432684 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:50.433362 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:50.433814 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:50.434297 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:50.566443 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:50.574261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-031f1e8f-5a91-4a48-80d6-b5680afddeef tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1453 microversion: 2.1 time: 0.154237 Sep 09 12:23:50.575593 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 485/990] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:50 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:50.597643 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:50.598254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:50.604280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:50.604758 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:50.605186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:50.605865 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:50.606533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:50.607061 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:50.738329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:50.746126 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d888e5e5-7725-4ca4-8451-e45c99fad50a tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1453 microversion: 2.1 time: 0.152249 Sep 09 12:23:50.747254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 506/991] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:50 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:51.714999 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:51.716148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:51.722478 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:51.722993 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:51.723432 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:51.724158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:51.724621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:51.725046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:51.748994 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c2ccbbe9-499f-4de9-95ab-9e39ccbadfa5 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/ips" status: 200 len: 146 microversion: 2.1 time: 0.037875 Sep 09 12:23:51.756429 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 486/992] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Sep 9 12:23:51 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:52.394785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52fdd8f-1d71-4ae3-9548-a7ca99df88f9", "tag": "990bb37e-8d61-4f15-8bcf-815b5ac9368e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:52.404614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:52.405173 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:52.405676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:52.416637 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] Creating event network-changed:990bb37e-8d61-4f15-8bcf-815b5ac9368e for instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 on hv-cinder-85221 Sep 09 12:23:52.422140 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-cd8cc513-12a7-4790-8ce5-583c2843e54d req-8e557614-6a32-4250-adb1-832b1c50db3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085733 Sep 09 12:23:52.422817 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 507/993] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:53.100746 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6d88972-4ce2-48bb-a24c-b3fb2ca00d88"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:53.103185 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:53.110196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:53.110688 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:53.111190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:53.111886 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:53.112340 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:53.112763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:53.363745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cc8957b0-be61-4c41-9610-bb4b3b374b06 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266772 Sep 09 12:23:53.364777 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 487/994] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:23:53 2022] POST /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:59.853137 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:59.855480 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:59.861693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.862215 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.862663 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.863424 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.863886 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.864309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.900980 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-63b6ee3b-fa9f-4607-93be-d520bb7753c6 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052433 Sep 09 12:23:59.901565 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 508/995] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:23:59 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:59.913765 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:59.914378 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:59.920867 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.921347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.921781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.922739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.923221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.923648 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.952839 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4ddba84d-dbb4-4fca-85dc-6fb9714af437 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88" status: 200 len: 194 microversion: 2.1 time: 0.044054 Sep 09 12:23:59.953417 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 488/996] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 9 12:23:59 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:01.281641 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dc3b46d-105f-4519-9cc6-3f7a85e32635"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:01.283994 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:01.290310 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:01.290791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:01.291254 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:01.291933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:01.292381 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:01.292796 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:01.526128 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b9636c7e-cd2f-470f-b3fe-ef94a201b750 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "POST /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248330 Sep 09 12:24:01.526728 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 509/997] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:24:01 2022] POST /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:09.067827 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:09.070095 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:09.072646 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=31 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:09.077953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.078439 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.078877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.079596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.080050 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.080475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.084337 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:09.112965 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-606ff7fb-e19d-4db8-97f6-0f9e2d1995c8 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049030 Sep 09 12:24:09.113516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 489/998] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:24:09 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:09.253777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:09.254392 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:09.256316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:09.262162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.262654 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.263110 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.263803 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.264253 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.264676 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.268690 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:09.296389 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ac561629-6f62-4d78-96f6-80e9869b7ff3 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88" status: 200 len: 194 microversion: 2.1 time: 0.047399 Sep 09 12:24:09.296967 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 510/999] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 9 12:24:09 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:09.307532 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:09.308019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:09.314549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.315067 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.315500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.316183 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:09.316630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:09.317046 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:09.401505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lazy-loading 'services' on Instance uuid afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:24:09.472981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5d285aec-d4f4-4e65-8437-99e067ecbdda tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88" status: 202 len: 0 microversion: 2.1 time: 0.169212 Sep 09 12:24:09.473577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 490/1000] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:24:09 2022] DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/f6d88972-4ce2-48bb-a24c-b3fb2ca00d88 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:24:10.602349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:10.602854 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:10.610020 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:10.610504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:10.610971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:10.611693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:10.612149 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:10.612580 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:10.641911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e100c576-8ebe-4435-9209-edd0b9750fab tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/6dc3b46d-105f-4519-9cc6-3f7a85e32635" status: 200 len: 194 microversion: 2.1 time: 0.043488 Sep 09 12:24:10.642498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 511/1001] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Sep 9 12:24:10 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/6dc3b46d-105f-4519-9cc6-3f7a85e32635 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:10.653523 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:10.654111 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:10.660832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:10.661324 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:10.661767 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:10.662459 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:10.662939 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:10.663376 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:10.744419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lazy-loading 'services' on Instance uuid afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:24:10.816102 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0fac9d43-a57d-44e0-b25b-6fe15a2f8a96 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/6dc3b46d-105f-4519-9cc6-3f7a85e32635" status: 202 len: 0 microversion: 2.1 time: 0.166653 Sep 09 12:24:10.816708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 491/1002] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:24:10 2022] DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments/6dc3b46d-105f-4519-9cc6-3f7a85e32635 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:24:11.993919 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:11.996175 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:12.002740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.003260 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.003701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.004394 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.004852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.005280 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.034968 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-696c0174-65c3-4b18-9404-686510f0f466 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044863 Sep 09 12:24:12.035571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 512/1003] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:24:11 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:24:12.152481 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:12.155393 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:12.161403 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.161891 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.162329 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.163045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.163502 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.163957 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.193919 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4ae359cb-8a23-452f-bfef-a185523e1e85 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046156 Sep 09 12:24:12.194466 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 492/1004] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Sep 9 12:24:12 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:24:12.258814 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:12.259333 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:12.265535 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.266011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.266445 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.267144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.267594 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.268011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.292179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:24:12.368043 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-497854fc-74ed-47e0-a65c-3e87a6a07e71 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 204 len: 0 microversion: 2.1 time: 0.112573 Sep 09 12:24:12.368780 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 513/1005] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:24:12 2022] DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:24:12.378680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:12.379331 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:12.385332 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.385812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.386245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.386953 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:12.387412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:12.388549 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:12.522277 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:12.530345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3addbec-ca29-4b3d-b201-1a5db103c48d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1670 microversion: 2.1 time: 0.156262 Sep 09 12:24:12.531148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 493/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:12 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:13.554444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:13.555185 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:13.562189 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:13.562686 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:13.563156 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:13.563857 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:13.564318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:13.564746 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:13.692755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:13.700603 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e6d93aa1-3555-4264-a99d-2f2fea1175e1 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1670 microversion: 2.1 time: 0.150423 Sep 09 12:24:13.701170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 514/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:13 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:14.727704 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:14.728356 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:14.740623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:14.741693 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:14.742435 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:14.743563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:14.744174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:14.744731 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:14.814186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '870f5366f958496d93c51e4b573e2487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e19a94fd744d9e94d9f5ff5b089f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:14.821821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb508949-532b-420d-a433-58e519ae9599 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 200 len: 1603 microversion: 2.1 time: 0.101213 Sep 09 12:24:14.822392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 494/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:14 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 1603 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:14.992143 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56", "name": "network-vif-deleted", "tag": "bf97cadb-f29e-43e0-b30e-987145da1d2c"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:15.003593 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:15.004093 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:15.004524 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:15.016385 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] Creating event network-vif-deleted:bf97cadb-f29e-43e0-b30e-987145da1d2c for instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 on hv-cinder-85221 Sep 09 12:24:15.021179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-c5a6ec2d-70fc-4797-a914-fe4fa0576131 req-df67dd83-6fc0-4205-8f4f-a8d7a26bac3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032692 Sep 09 12:24:15.025014 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 515/1009] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:15.846204 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:15.846843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:15.853260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:15.853739 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:15.854167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:15.854847 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:15.855361 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:15.855781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:15.869556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 HTTP/1.1 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:24:15.871269 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:15.872933 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56'} Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:15.873941 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:15.875745 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:15.877209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:15.877209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8c98fec5-17dd-427d-9404-910d7105a21c tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 404 len: 111 microversion: 2.1 time: 0.030487 Sep 09 12:24:15.877209 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 495/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:15 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:15.882170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f46effc0-60f5-413f-a834-00bfbdcf1b15 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '.version_select at 0x7f6bd0a9c1f0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:15.901652 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f46effc0-60f5-413f-a834-00bfbdcf1b15 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4395205" status: 202 len: 0 microversion: 2.1 time: 0.023551 Sep 09 12:24:15.902248 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 516/1011] 10.222.0.49 () {58 vars in 1212 bytes} [Fri Sep 9 12:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4395205 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:24:18.791275 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:18.791810 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:18.799147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:18.799634 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:18.800074 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:18.800769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:18.801225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:18.801652 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:18.815967 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 HTTP/1.1 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:24:18.817509 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.819349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56'} Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:18.820281 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.821500 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.822764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:18.822764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ef778dbc-03a4-454d-95c4-8c4d33e2e07d tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 404 len: 111 microversion: 2.1 time: 0.031442 Sep 09 12:24:18.822764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 496/1012] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:24:18 2022] DELETE /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:18.828479 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:18.829214 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:18.837567 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:18.838054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:18.838490 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:18.839209 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:18.839672 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:18.840098 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:18.853091 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 HTTP/1.1 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:24:18.854706 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.856391 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': 'afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56'} Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:18.857956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. Sep 09 12:24:18.859520 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:18.860897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:18.860897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-69690c53-393d-4536-8f5a-b5e5b1bd51ae tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56" status: 404 len: 111 microversion: 2.1 time: 0.032034 Sep 09 12:24:18.860897 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 517/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:18 2022] GET /compute/v2.1/servers/afe59ad9-dd65-42b4-abaa-b8bc8c0a7e56 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:19.993562 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:19.994064 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:20.000753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:20.001240 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:20.001680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:20.002372 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:20.002829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:20.003321 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:20.016806 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 HTTP/1.1 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:24:20.018348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.019982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '92414745-4f7c-41ec-bcec-e2d6736c9786'} Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:20.021122 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.022595 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.024062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:20.024062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-470ee86d-d5f7-4523-9c47-22ff77654a08 tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 404 len: 111 microversion: 2.1 time: 0.030045 Sep 09 12:24:20.024062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 497/1014] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:24:19 2022] DELETE /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:20.028145 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:20.029444 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] [instance: 92414745-4f7c-41ec-bcec-e2d6736c9786] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:20.035821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:20.036304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:20.036739 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:20.037425 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:20.037877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:20.038301 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:20.052376 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] HTTP exception thrown: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Request method failure captured: Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 HTTP/1.1 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy9_B6QvBoHL21vDs5IQwZf_ZxXCMPHJfA_27IDLrfTL5X5NlPXRU1ycgU3XvRhKEsc5GYWtWyMuwoTeJKqfs7n8n__UzE4X5daUcdEIu3E_EtzIQaDD5czTG1L2UMl8xfs96jg-39h0Kk7FfAI8vuaKJTT93iYTgQJKl1ExblQmQ1U Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:24:20.053883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/69e19a94fd744d9e94d9f5ff5b089f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 69e19a94fd744d9e94d9f5ff5b089f15 Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547593510 Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 870f5366f958496d93c51e4b573e2487 Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1547593510-project Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.055497 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '92414745-4f7c-41ec-bcec-e2d6736c9786'} Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:20.056404 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. Sep 09 12:24:20.057896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:24:20.059339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] Returning 404 to user: Instance 92414745-4f7c-41ec-bcec-e2d6736c9786 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:20.059339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8820faac-0767-4bd9-b5d7-5235a49a226a tempest-AttachVolumeTestJSON-1547593510 tempest-AttachVolumeTestJSON-1547593510-project] 10.222.0.49 "GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786" status: 404 len: 111 microversion: 2.1 time: 0.030992 Sep 09 12:24:20.059339 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 518/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:20 2022] GET /compute/v2.1/servers/92414745-4f7c-41ec-bcec-e2d6736c9786 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:24:53.709648 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-859983135", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "networks": [{"uuid": "d484b593-2024-4f92-9a46-04864c992385"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:53.719168 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=17 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:53.719803 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:53.766413 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] validate_networks() for [('d484b593-2024-4f92-9a46-04864c992385', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:24:54.406099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:24:54.406524 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:24:54.407032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:24:54.407452 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:24:54.407864 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:24:54.416647 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:54.417132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:54.417577 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:54.418306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:54.418761 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:54.419223 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:54.438649 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Getting quotas for project 9b0b40d750ab4721a1339c8d2c8d5052. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:24:54.442710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Getting quotas for user 52fe2bbd491f40b2a9e99ef2a33c9e84 and project 9b0b40d750ab4721a1339c8d2c8d5052. Resources: {'instances', 'cores', 'ram'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:24:54.455004 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:24:54.457306 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:24:54.504368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3fcb9ee1-3892-439d-8fd5-e4c3c37d467c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798631 Sep 09 12:24:54.505016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 498/1016] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:24:54.516791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fb0d429a-49f0-40ef-b95a-4a98d4b40b93 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:54.517406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fb0d429a-49f0-40ef-b95a-4a98d4b40b93 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:54.519777 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:54.520439 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:54.578558 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fb0d429a-49f0-40ef-b95a-4a98d4b40b93 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:54.585398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fb0d429a-49f0-40ef-b95a-4a98d4b40b93 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1218 microversion: 2.1 time: 0.073035 Sep 09 12:24:54.585956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 519/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:54 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:55.609914 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:55.610617 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:55.618025 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:55.618529 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:55.618986 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:55.619903 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:55.620357 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:55.620780 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:55.698300 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:55.706469 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ca2caa20-d88d-402d-b088-54bec7bf2648 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1276 microversion: 2.1 time: 0.102002 Sep 09 12:24:55.707081 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 499/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:55 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:56.729750 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:56.730491 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:56.737356 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:56.738059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:56.738501 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:56.739224 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:56.739686 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:56.740144 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:56.798775 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfd5357-c9ac-4d43-b406-c50a49e848be", "tag": "43dced29-ff94-4b90-bf8e-19b4452e512c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:56.809769 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:56.810801 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:56.811260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:56.822411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] Creating event network-changed:43dced29-ff94-4b90-bf8e-19b4452e512c for instance 0bfd5357-c9ac-4d43-b406-c50a49e848be on hv-cinder-85221 Sep 09 12:24:56.828194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6861c35b-528e-4f8b-8255-aa2a8fe2eca8 req-5078f833-a249-4457-bafa-27a331bab9bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Sep 09 12:24:56.829118 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 500/1019] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:24:56.890951 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:56.898610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8b21677b-0de3-4787-9590-25f7951eb925 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.172955 Sep 09 12:24:56.899205 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 520/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:56 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:57.922870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:57.923644 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:57.930035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:57.930515 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:57.930973 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:57.931710 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:57.932198 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:57.932627 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:58.064165 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:58.071934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8dd7e787-faff-4046-84f7-78a4130c4e82 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.154372 Sep 09 12:24:58.072498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 501/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:57 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:59.094703 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:59.095352 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:59.101922 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:59.102414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:59.102852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:59.103614 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:59.104073 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:59.104503 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:59.235299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:59.242866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-318725ad-e1d2-47eb-b414-df46bbca65b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.152070 Sep 09 12:24:59.243465 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 521/1022] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:59 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:00.266964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:00.267581 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:00.274045 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.274527 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.274992 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.275716 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.276172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.276598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.404635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:00.412299 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d08e2e4b-68dd-49f0-a574-9f3c6ccf5e9b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.149745 Sep 09 12:25:00.412866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 502/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:00 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:01.435687 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:01.436330 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:01.442776 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:01.443296 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:01.443733 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:01.444422 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:01.444877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:01.445298 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:01.575717 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:01.584252 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cc1ecd8d-b3ee-4b56-b625-5e2b2ac2b13c tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.152401 Sep 09 12:25:01.584814 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 522/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:01 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:02.537697 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfd5357-c9ac-4d43-b406-c50a49e848be", "name": "network-vif-plugged", "status": "completed", "tag": "43dced29-ff94-4b90-bf8e-19b4452e512c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:02.548598 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:02.549115 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:02.549579 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:02.561917 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] Creating event network-vif-plugged:43dced29-ff94-4b90-bf8e-19b4452e512c for instance 0bfd5357-c9ac-4d43-b406-c50a49e848be on hv-cinder-85221 Sep 09 12:25:02.566932 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-3951faf7-1062-49a3-b03f-32090995cd8c req-8dc31927-81f7-4848-a12a-4a6ff3401a05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Sep 09 12:25:02.567526 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 503/1025] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:02.607533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:02.609077 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:02.615668 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:02.616161 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:02.616602 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:02.617300 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:02.617754 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:02.618213 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:02.752855 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:02.760620 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eb2c8b9d-5448-4c16-a76f-70e63e033bd5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.156942 Sep 09 12:25:02.761203 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 523/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:02 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:03.785946 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:03.786653 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:03.792936 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:03.793411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:03.793848 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:03.794542 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:03.795036 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:03.795467 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:03.928073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:03.935696 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-379fb8be-c847-4df4-906f-8526de919ec6 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1318 microversion: 2.1 time: 0.154534 Sep 09 12:25:03.936267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 504/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:03 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:04.959289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:04.960001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:04.962350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:04.967794 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:04.968278 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:04.968711 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:04.969452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:04.969906 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:04.970324 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:05.102722 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:05.110406 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e41f8a81-e223-4ae7-8d5d-4c76164a5fba tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1507 microversion: 2.1 time: 0.155092 Sep 09 12:25:05.110986 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 524/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:04 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:25:19.275730 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2b88b1-e851-47d9-8808-856643236ef1", "device": "/dev/sdb"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:19.278616 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:19.280752 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:19.281412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:19.282259 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:19.283113 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=30 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:19.291042 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:19.291528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:19.291964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:19.292658 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:19.293114 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:19.293538 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:19.545006 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e27a7211-16af-43e8-83d9-c7d37b18b794 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "POST /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272930 Sep 09 12:25:19.545679 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 505/1029] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:25:19 2022] POST /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:26.296577 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-812149987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1082182416", "security_groups": [{"name": "tempest-secgroup-smoke-168402175"}], "block_device_mapping_v2": [{"uuid": "2694aa70-be07-437a-a4ab-0d4b52bc4e28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b4dd0d4-7e37-4727-977d-26ef008eabd3"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:26.308476 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=14 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:26.309275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=30 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:26.412852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] validate_networks() for [('0b4dd0d4-7e37-4727-977d-26ef008eabd3', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:25:26.780162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:25:26.780766 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:25:26.781293 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:25:26.781765 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:25:26.782192 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:25:26.791579 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:26.792058 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:26.792484 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:26.793199 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:26.793647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:26.794068 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:26.811088 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:25:26.814982 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Getting quotas for user e2391d64c9304317bfb53e79ee0ca764 and project c9c41d17597b4d3a8ffafa3d5bb87916. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:25:26.871693 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:25:26.873880 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2694aa70-be07-437a-a4ab-0d4b52bc4e28',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:25:27.002859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d0b08558-e866-4428-82a5-4d626128a766 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710253 Sep 09 12:25:27.003560 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 525/1030] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:25:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:25:27.015789 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0bf3bec2-9a1b-4c9d-9be9-3983cc141477 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:27.017108 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0bf3bec2-9a1b-4c9d-9be9-3983cc141477 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:27.075792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0bf3bec2-9a1b-4c9d-9be9-3983cc141477 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:27.083401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0bf3bec2-9a1b-4c9d-9be9-3983cc141477 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1094 microversion: 2.1 time: 0.071743 Sep 09 12:25:27.084094 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 506/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:27 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:28.106402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:28.107190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:28.113718 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:28.114224 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:28.115563 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:28.116201 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:28.116962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:28.117386 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:28.181902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:28.189495 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fb11d0d4-cbc5-4cec-9138-b967cfee7012 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1192 microversion: 2.1 time: 0.087443 Sep 09 12:25:28.190046 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 526/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:28 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:29.214421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:29.215829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:29.229486 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:29.231139 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:29.231785 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:29.232837 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:29.233498 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:29.237236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:29.443637 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:29.453132 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e6e885b2-e273-4ce6-9127-e1b081a711d9 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1277 microversion: 2.1 time: 0.242677 Sep 09 12:25:29.467315 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 507/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:29 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:30.047698 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0107a0d-0ecf-4b6b-9227-65da9d39c264", "tag": "2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:30.058930 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:30.059447 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:30.059890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:30.071644 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] Creating event network-changed:2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6 for instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 on hv-cinder-85221 Sep 09 12:25:30.076538 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-02689402-fe06-4e82-bc5e-033ad5ce9c04 req-baa95610-e98a-4178-b5df-9e7e2fdc02b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Sep 09 12:25:30.077338 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 527/1034] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:30.480715 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:30.481245 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:30.487887 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:30.488370 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:30.488809 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:30.490194 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:30.490651 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:30.491110 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:30.624274 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:30.632864 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7eed6c4f-8ca4-4f50-a8fa-0572a51ded97 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.157279 Sep 09 12:25:30.633436 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 508/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:30 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:31.657223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:31.657948 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:31.664646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:31.665124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:31.665561 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:31.666346 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:31.666797 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:31.667242 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:31.796915 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:31.805353 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e118505-0f5d-42d7-bcb1-003240942fbb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.153003 Sep 09 12:25:31.805916 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 528/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:31 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:32.840763 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:32.843174 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:32.849931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:32.850427 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:32.850972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:32.851823 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:32.852359 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:32.852795 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:32.998611 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:33.007225 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-70901b30-d915-4b14-90d8-cc7d6f6be0a6 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.170918 Sep 09 12:25:33.007776 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 509/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:32 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:34.029504 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:34.030113 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:34.036412 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:34.036889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:34.037321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:34.038001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:34.038456 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:34.038877 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:34.172411 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:34.180299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a45fd908-9b0d-49ff-ae47-66c800f8816f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.154660 Sep 09 12:25:34.180856 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 529/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:34 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:35.203650 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:35.204288 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:35.211567 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:35.212043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:35.212481 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:35.213160 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:35.213602 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:35.214019 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:35.346048 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:35.354753 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9888f926-a76b-4c65-a00d-44fe7e9668ec tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.155046 Sep 09 12:25:35.355346 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 510/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:35 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:36.377268 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:36.377879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:36.384469 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:36.384952 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:36.385388 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:36.386075 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:36.386532 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:36.386981 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:36.520686 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:36.528351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d03c3e53-bb16-4310-a832-3def2738cb3b tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.155045 Sep 09 12:25:36.528920 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 530/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:36 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:37.552153 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:37.552904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:37.555242 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:37.560686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:37.561167 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:37.561597 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:37.562276 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:37.562725 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:37.563170 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:37.697419 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:37.705258 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-89df5d41-fad4-4d94-a2e9-445e2556eab3 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.157697 Sep 09 12:25:37.705829 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 511/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:37 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:38.729067 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:38.729741 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:38.731996 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:38.732689 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:38.740204 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:38.740701 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:38.741197 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:38.741872 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:38.742326 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:38.742771 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:38.888957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:38.898972 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-315178cb-996d-4a4e-ae52-cc7508f229c0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.173420 Sep 09 12:25:38.899925 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 531/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:38 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:39.922421 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:39.923016 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:39.930796 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:39.931320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:39.931760 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:39.932458 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:39.932915 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:39.933345 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:40.062680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:40.070836 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8d16febe-73d4-459a-9bc2-df62c9959712 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.152397 Sep 09 12:25:40.071426 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 512/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:39 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:41.093647 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:41.094263 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:41.100831 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:41.101318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:41.101756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:41.102540 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:41.103025 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:41.103453 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:41.243436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:41.254060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-caa09041-19b9-4d66-bfa8-ce10e4517d54 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.163408 Sep 09 12:25:41.254639 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 532/1044] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:41 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:42.277934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:42.278544 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:42.285007 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:42.285483 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:42.287318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:42.287318 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:42.287600 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:42.288032 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:42.425547 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:42.433870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ab36fe0a-a28f-471b-9618-987723a0aa46 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.159785 Sep 09 12:25:42.434457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 513/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:42 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:25:43.456515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:43.457133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:43.464697 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:43.465174 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:43.465612 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:43.466308 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:43.466763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:43.467218 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:43.606284 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:43.615306 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2395ad87-c5e8-46b5-9bd5-37464059fa7e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.161658 Sep 09 12:25:43.615888 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 533/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:43 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:44.527949 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:44.528448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:44.534792 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:44.535313 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:44.535748 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:44.536999 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:44.537473 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:44.537897 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:44.619078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lazy-loading 'services' on Instance uuid 0bfd5357-c9ac-4d43-b406-c50a49e848be {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:25:44.637365 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:44.638082 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:44.644801 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:44.645402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:44.645990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:44.646768 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:44.647804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:44.647804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:44.700507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b5b26a8e-687a-4de9-8019-289171e9639f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be/os-volume_attachments/9c2b88b1-e851-47d9-8808-856643236ef1" status: 202 len: 0 microversion: 2.1 time: 0.176279 Sep 09 12:25:44.701186 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 514/1047] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:25:44 2022] DELETE /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be/os-volume_attachments/9c2b88b1-e851-47d9-8808-856643236ef1 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:25:44.794742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:44.803684 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7b278fdd-08c0-47f0-9fc3-4e07c29992eb tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.170032 Sep 09 12:25:44.804294 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 534/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:44 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:25:45.826503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:45.827407 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:45.834255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:45.834997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:45.835681 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:45.836846 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:45.837903 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:45.838335 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:45.845420 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:45.845938 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:45.852362 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:45.852859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:45.853299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:45.854011 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:45.854470 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:45.854921 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:45.882522 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:25:45.970616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b12df43f-f493-4b45-90bc-c2063bbe63b9 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 204 len: 0 microversion: 2.1 time: 0.128913 Sep 09 12:25:45.975117 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 535/1049] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:25:45 2022] DELETE /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:25:45.978177 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0107a0d-0ecf-4b6b-9227-65da9d39c264", "name": "network-vif-plugged", "status": "completed", "tag": "2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:45.983196 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:45.988051 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:45.988531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:45.988983 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:45.994719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-37086c9e-2e6e-4575-8545-c5b170b0d78e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.172863 Sep 09 12:25:45.995314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 515/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:45 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:45.999719 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:46.000320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:46.001165 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] Creating event network-vif-plugged:2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6 for instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 on hv-cinder-85221 Sep 09 12:25:46.006054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-bcb77938-1169-4b7e-a077-66495d76f91a req-97ed84bd-b9fd-46b8-8724-c1f61682b3a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Sep 09 12:25:46.006834 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 536/1051] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:46.007870 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:46.008456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:46.008786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:46.009479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:46.009934 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:46.010349 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:46.138237 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:46.146123 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8c4dc4bc-5371-4f0e-be62-3be0295cf6c3 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1513 microversion: 2.1 time: 0.149860 Sep 09 12:25:46.146685 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 516/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:45 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:47.018375 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:47.019103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:47.025841 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:47.026318 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:47.026749 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:47.027461 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:47.027911 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:47.028327 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:47.161329 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:47.169115 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-86913401-d9b3-4bc2-a66a-b745a6e2387c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.155373 Sep 09 12:25:47.169537 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:47.170080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 537/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:47 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:47.170365 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:47.177319 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:47.177807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:47.178261 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:47.178987 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:47.179448 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:47.179876 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:47.310342 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:47.319488 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8e390760-811f-4be1-89c8-fcceedfc6666 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1513 microversion: 2.1 time: 0.153726 Sep 09 12:25:47.320062 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 517/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:47 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:25:48.147576 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfd5357-c9ac-4d43-b406-c50a49e848be", "name": "network-vif-deleted", "tag": "43dced29-ff94-4b90-bf8e-19b4452e512c"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:48.157441 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.157940 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.158550 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.170999 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] Creating event network-vif-deleted:43dced29-ff94-4b90-bf8e-19b4452e512c for instance 0bfd5357-c9ac-4d43-b406-c50a49e848be on hv-cinder-85221 Sep 09 12:25:48.175902 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-1075a461-f075-4a50-b408-748367205987 req-c783baa8-a7db-4fb9-b75d-841f1eb6cc29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033158 Sep 09 12:25:48.176487 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 538/1055] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:48.191394 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:48.192013 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:48.198996 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.199492 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.199931 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.200732 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.201211 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.201618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.344234 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:48.344531 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:48.345299 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:48.351791 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.352282 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.352479 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d77f90a-eff8-4f96-b2f5-ff61e8bfd7f8 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1265 microversion: 2.1 time: 0.164879 Sep 09 12:25:48.352775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.353230 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 518/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:48 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:48.353517 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.353976 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.354405 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.387572 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:48.388054 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:48.388492 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:48.388946 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lazy-loading 'fault' on Instance uuid 0bfd5357-c9ac-4d43-b406-c50a49e848be {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:25:48.433181 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:48.441863 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-944332e2-3161-46e0-9f2c-083fad8e641e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 200 len: 1308 microversion: 2.1 time: 0.101547 Sep 09 12:25:48.443059 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 539/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:48 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:49.376316 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:49.376878 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:49.379326 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=31 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:49.384964 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.385444 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.385877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.386563 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.387035 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.387457 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.390015 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:49.466590 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:49.467357 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: 0bfd5357-c9ac-4d43-b406-c50a49e848be] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:49.474883 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.475956 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.476398 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.477092 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.477543 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.477962 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.492021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] HTTP exception thrown: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Request method failure captured: Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be HTTP/1.1 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGzCUoJa-tMboNaC7fQaM5jjnXOVXYou3ARQA0QCmrt6tRpE5VjKK_pOhRuDBqPfI5CVqM3KuRf6SN2-bhAcultmhDVpZokLsbNwW0Fx_8Cdz-1ZRTh0jOk6EWaG4syiNYTMxADB6S2qSV9ur1jdyp4tOtpn53GPkUE9gNtjCrgU9OKE Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b0b40d750ab4721a1339c8d2c8d5052 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:25:49.493671 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b0b40d750ab4721a1339c8d2c8d5052 Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesSnapshotTestJSON-1977479924-project Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: 52fe2bbd491f40b2a9e99ef2a33c9e84 Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesSnapshotTestJSON-1977479924-project Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. Sep 09 12:25:49.495316 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '0bfd5357-c9ac-4d43-b406-c50a49e848be'} Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:25:49.496545 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. Sep 09 12:25:49.497964 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:25:49.499890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Returning 404 to user: Instance 0bfd5357-c9ac-4d43-b406-c50a49e848be could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:25:49.499890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-57c6077d-6f11-41fc-9106-799acb429ced tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be" status: 404 len: 111 microversion: 2.1 time: 0.032619 Sep 09 12:25:49.499890 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 540/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:49 2022] GET /compute/v2.1/servers/0bfd5357-c9ac-4d43-b406-c50a49e848be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:25:49.522336 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:49.530199 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-06bf7b3d-ac15-4ea0-9ca0-0577a589172e tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1453 microversion: 2.1 time: 0.157799 Sep 09 12:25:49.530758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 519/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:49 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:49.553017 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:49.553630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:49.559616 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.560103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.560541 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.561233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:49.561692 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:49.562148 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:49.719170 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:49.727211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-91dff704-3954-479f-ac62-70c1f0d437ca tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1453 microversion: 2.1 time: 0.178416 Sep 09 12:25:49.727778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 541/1060] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:49 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:51.286391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0107a0d-0ecf-4b6b-9227-65da9d39c264", "tag": "2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:51.296938 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:51.297414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:51.297843 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:51.309505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] Creating event network-changed:2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6 for instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 on hv-cinder-85221 Sep 09 12:25:51.314670 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ecfc7f1d-a6f3-42f2-b6c4-cdb68bfe4120 req-282bbad6-fac3-4b03-a5e6-9959d2c2252c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031962 Sep 09 12:25:51.315292 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 520/1061] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:25:57.312009 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1502347957", "imageRef": "f0fb6fa5-20c9-4c60-8208-39134af17d95", "flavorRef": "452", "networks": [{"uuid": "d484b593-2024-4f92-9a46-04864c992385"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:57.320936 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:57.367790 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] validate_networks() for [('d484b593-2024-4f92-9a46-04864c992385', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:25:57.713001 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:25:57.713432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:25:57.713917 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:25:57.714331 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:25:57.714747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:25:57.723586 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:57.724016 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:57.724455 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:57.725350 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:57.725804 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:57.726233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:57.732852 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:25:57.745853 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Getting quotas for project 9b0b40d750ab4721a1339c8d2c8d5052. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:25:57.749813 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Getting quotas for user 52fe2bbd491f40b2a9e99ef2a33c9e84 and project 9b0b40d750ab4721a1339c8d2c8d5052. Resources: {'instances', 'cores', 'ram'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:25:57.761250 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:25:57.763560 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0fb6fa5-20c9-4c60-8208-39134af17d95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:25:57.809365 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5def7ee2-9df1-4550-997d-332d83596f2f tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501423 Sep 09 12:25:57.810365 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 542/1062] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Sep 9 12:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:25:57.822583 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e892aa0a-37d2-4968-8c55-695ee271b74b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:57.823309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e892aa0a-37d2-4968-8c55-695ee271b74b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:57.879736 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e892aa0a-37d2-4968-8c55-695ee271b74b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:57.887309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e892aa0a-37d2-4968-8c55-695ee271b74b tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1219 microversion: 2.1 time: 0.069743 Sep 09 12:25:57.887970 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 521/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:57 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:58.911211 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:58.911756 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:58.918608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:58.919127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:58.919564 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:58.920238 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:58.920685 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:58.921104 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:58.982585 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:58.990168 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6232d754-6282-465b-a901-b94b4b945a0a tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1279 microversion: 2.1 time: 0.083765 Sep 09 12:25:58.990732 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 543/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:58 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:00.012779 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:00.013392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:00.019927 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:00.020412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:00.020851 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:00.021541 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:00.022020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:00.022453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:00.159582 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:00.168785 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5fc1bbde-4a32-49e8-b75f-f1c910802bbb tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.159769 Sep 09 12:26:00.169477 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 522/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:00 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:00.372498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a224c419-61b1-499f-aa7a-a346d667f6f9", "tag": "3a04ba7a-09c4-4868-bb54-377c72008cdd"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:26:00.384129 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:00.384609 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:00.385042 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:00.396233 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] Creating event network-changed:3a04ba7a-09c4-4868-bb54-377c72008cdd for instance a224c419-61b1-499f-aa7a-a346d667f6f9 on hv-cinder-85221 Sep 09 12:26:00.402092 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-29d46383-1873-4cf9-af04-4c7a4a465926 req-bdb83235-6a8c-4994-b0e6-117fcb6fea81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033264 Sep 09 12:26:00.402696 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 544/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:26:01.192724 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:01.193341 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:01.200485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:01.200972 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:01.201412 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:01.202109 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:01.202569 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:01.203028 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:01.334636 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:01.342260 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-64c6a59d-8b4b-456c-9b8c-30fa23df6faa tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.153398 Sep 09 12:26:01.342826 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 523/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:01 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:02.366630 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:02.367351 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:02.373505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:02.373990 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:02.374426 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:02.375147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:02.375606 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:02.376030 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:02.511441 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:02.519186 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3bf48843-6e95-40d9-ad44-ab9154e47b32 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.157228 Sep 09 12:26:02.519759 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 545/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:02 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:03.542475 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:03.543101 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:03.549456 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:03.549935 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:03.550360 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:03.551073 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:03.551528 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:03.551947 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:03.680399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:03.688220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dfe80a25-5975-4e6e-acc9-5db0bcbecff0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.150289 Sep 09 12:26:03.688781 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 524/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:03 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:04.712100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:04.712710 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:04.719370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:04.719844 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:04.720273 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:04.720954 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:04.721400 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:04.721820 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:04.852162 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:04.859839 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e91c6e11-8f7f-4ca2-b27c-e7a5fa5eff42 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.152212 Sep 09 12:26:04.860402 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 546/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:04 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:05.882812 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:05.883441 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:05.889786 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:05.890273 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:05.890708 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:05.891428 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:05.891918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:05.892347 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:05.972971 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a224c419-61b1-499f-aa7a-a346d667f6f9", "name": "network-vif-plugged", "status": "completed", "tag": "3a04ba7a-09c4-4868-bb54-377c72008cdd"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:26:05.983442 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:05.983928 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:05.984436 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:05.998787 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] Creating event network-vif-plugged:3a04ba7a-09c4-4868-bb54-377c72008cdd for instance a224c419-61b1-499f-aa7a-a346d667f6f9 on hv-cinder-85221 Sep 09 12:26:06.004228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-d3ca7068-b0d3-4daa-b03f-7a902a325273 req-00ee0df8-3bdc-40d0-8287-a7d415be5159 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034911 Sep 09 12:26:06.005133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 547/1071] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:26:06.034361 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:06.043505 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-60bfea49-cbcf-4a8c-b0c7-4865c4b45941 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.164728 Sep 09 12:26:06.044079 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 525/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:05 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:07.067773 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:07.068500 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:07.075896 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:07.076414 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:07.076882 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:07.077608 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:07.078074 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:07.078502 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:07.207605 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:07.215536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0e7715a2-4c7f-4e83-a21a-c960444cd0da tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1319 microversion: 2.1 time: 0.151937 Sep 09 12:26:07.216103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 548/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:07 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:08.239369 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:08.239866 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:08.243307 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:08.248659 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:08.249136 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:08.249575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:08.250255 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:08.250701 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:08.251150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:08.381603 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:08.389401 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b1b4aa59-3d71-4a66-8db4-8e3eba3882d2 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1508 microversion: 2.1 time: 0.154003 Sep 09 12:26:08.389968 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 526/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:08 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:08.413510 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b633f8-0f14-4584-9085-8780f800cabc", "device": "/dev/sdb"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:26:08.416578 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:08.418505 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:08.419321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:08.425275 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:08.425755 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:08.426190 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:08.426873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:08.427349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:08.428124 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:08.662261 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-47ec25a5-0192-4eba-94e4-2c32f9d6b3a0 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "POST /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253318 Sep 09 12:26:08.662873 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 549/1075] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Sep 9 12:26:08 2022] POST /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:26:26.968516 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:26.969030 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:26.970982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=17 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:26.971680 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=37 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:26.977722 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:26.978266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:26.978696 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:26.979405 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:26.979857 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:26.980283 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:27.062348 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lazy-loading 'services' on Instance uuid a224c419-61b1-499f-aa7a-a346d667f6f9 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:26:27.133270 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-97af84af-0243-4d62-b22d-0fe10b405fe5 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9/os-volume_attachments/43b633f8-0f14-4584-9085-8780f800cabc" status: 202 len: 0 microversion: 2.1 time: 0.168527 Sep 09 12:26:27.133864 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 527/1076] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Sep 9 12:26:26 2022] DELETE /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9/os-volume_attachments/43b633f8-0f14-4584-9085-8780f800cabc => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:26:28.253736 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:28.254646 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:26:28.259738 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:28.260355 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:28.267939 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:28.268423 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:28.268859 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:28.269549 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:28.270004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:28.270428 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:28.297452 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:26:28.374056 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c807068e-af87-4702-bf96-72f30d1f154e tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 204 len: 0 microversion: 2.1 time: 0.121511 Sep 09 12:26:28.374740 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 550/1077] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:26:28 2022] DELETE /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:26:28.385099 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:28.385807 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:28.392507 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:28.392984 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:28.393414 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:28.394096 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:28.394627 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:28.395078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:28.525189 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:28.538381 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-57ca2981-e4cb-4c31-9283-6be6768d1578 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1514 microversion: 2.1 time: 0.158399 Sep 09 12:26:28.538982 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 528/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:28 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:29.562223 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:29.562942 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:29.569381 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:29.569866 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:29.570304 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:29.571122 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:29.571610 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:29.572038 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:29.706080 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:29.714451 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2fa6d9d9-bbdf-4030-8886-d69884242956 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1514 microversion: 2.1 time: 0.156478 Sep 09 12:26:29.715041 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 551/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:29 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:30.551044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a224c419-61b1-499f-aa7a-a346d667f6f9", "name": "network-vif-deleted", "tag": "3a04ba7a-09c4-4868-bb54-377c72008cdd"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:26:30.563094 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:30.563586 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:30.564018 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:30.576033 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] Creating event network-vif-deleted:3a04ba7a-09c4-4868-bb54-377c72008cdd for instance a224c419-61b1-499f-aa7a-a346d667f6f9 on hv-cinder-85221 Sep 09 12:26:30.580713 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-b4f8bf00-c3fe-466c-801a-d94159426fb3 req-466bb220-cb97-472a-976d-46e10c9e9954 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Sep 09 12:26:30.581309 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 529/1080] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:26:30.738660 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:30.739337 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:30.746127 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:30.746621 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:30.747106 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:30.747810 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:30.748269 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:30.748885 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:30.781879 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:30.782370 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:30.782808 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:30.783281 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lazy-loading 'fault' on Instance uuid a224c419-61b1-499f-aa7a-a346d667f6f9 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:26:30.825747 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52fe2bbd491f40b2a9e99ef2a33c9e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0b40d750ab4721a1339c8d2c8d5052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:26:30.833785 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bcc2c26d-93e2-4e96-84a2-fa2f57c4c5a4 tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 200 len: 1309 microversion: 2.1 time: 0.099019 Sep 09 12:26:30.834349 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 552/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:30 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:26:31.858920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:26:31.859618 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] [instance: a224c419-61b1-499f-aa7a-a346d667f6f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:26:31.865754 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:31.866236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:31.866675 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:31.867392 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:26:31.868355 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:26:31.868784 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:26:31.884433 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] HTTP exception thrown: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Request method failure captured: Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 HTTP/1.1 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGzCUoJa-tMboNaC7fQaM5jjnXOVXYou3ARQA0QCmrt6tRpE5VjKK_pOhRuDBqPfI5CVqM3KuRf6SN2-bhAcultmhDVpZokLsbNwW0Fx_8Cdz-1ZRTh0jOk6EWaG4syiNYTMxADB6S2qSV9ur1jdyp4tOtpn53GPkUE9gNtjCrgU9OKE Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: 9b0b40d750ab4721a1339c8d2c8d5052 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:26:31.886044 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b0b40d750ab4721a1339c8d2c8d5052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 9b0b40d750ab4721a1339c8d2c8d5052 Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1977479924 Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotTestJSON-1977479924-project Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: 52fe2bbd491f40b2a9e99ef2a33c9e84 Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotTestJSON-1977479924-project Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. Sep 09 12:26:31.887875 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'a224c419-61b1-499f-aa7a-a346d667f6f9'} Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:26:31.888755 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. Sep 09 12:26:31.890121 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:26:31.891411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] Returning 404 to user: Instance a224c419-61b1-499f-aa7a-a346d667f6f9 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:26:31.891411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b705c493-8281-45e8-b633-7a035b7186fd tempest-VolumesSnapshotTestJSON-1977479924 tempest-VolumesSnapshotTestJSON-1977479924-project] 10.222.0.49 "GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9" status: 404 len: 111 microversion: 2.1 time: 0.033244 Sep 09 12:26:31.891411 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 530/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:26:31 2022] GET /compute/v2.1/servers/a224c419-61b1-499f-aa7a-a346d667f6f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:27:32.004821 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:32.005568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:32.007759 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:27:32.007918 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 12:27:32.008309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Fri Sep 9 12:27:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 (ip 10.222.0.49) !!! Sep 09 12:27:32.008406 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Fri Sep 9 12:27:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 09 12:27:32.009399 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:27:32.009758 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Fri Sep 9 12:27:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 09 12:27:32.011391 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=8 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:32.012669 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:32.016568 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:32.017083 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:32.018314 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0107a0d-0ecf-4b6b-9227-65da9d39c264", "tag": "2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:32.028544 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.029040 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.030515 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.032323 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.032474 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.032851 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.032966 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.033289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.033398 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.047630 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] Creating event network-changed:2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6 for instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 on hv-cinder-85221 Sep 09 12:27:32.052907 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e81a19a2-6b46-46e6-98d7-76811e403dc0 req-244ee37e-3df6-4555-9fff-7d51ea539e9a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047638 Sep 09 12:27:32.054267 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 531/1083] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:32.063604 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:27:32.147743 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a1c608d5-4bb1-4338-8fa0-6c74a776f4d0 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 204 len: 0 microversion: 2.1 time: 0.144158 Sep 09 12:27:32.148953 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 553/1084] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:27:32 2022] DELETE /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:27:32.157920 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:32.158623 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:32.165320 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.165804 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.166244 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.167503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.167503 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.167832 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.303692 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:32.312575 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-71e90a38-dc2e-417c-b20a-16e48883a7cf tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1578 microversion: 2.1 time: 0.159329 Sep 09 12:27:32.313150 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 532/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:32 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:33.338147 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:33.338848 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:33.345364 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:33.345849 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:33.346289 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:33.347004 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:33.347464 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:33.347889 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:33.483775 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:33.491742 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-43b4ca2c-c793-4d58-a210-a95df9e21b41 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1578 microversion: 2.1 time: 0.157796 Sep 09 12:27:33.492319 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 554/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:33 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:34.128468 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0107a0d-0ecf-4b6b-9227-65da9d39c264", "name": "network-vif-deleted", "tag": "2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:34.141147 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.141645 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.142078 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:34.156221 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] Creating event network-vif-deleted:2d88ad3d-8e6e-4b0b-a1e6-2947b0d712e6 for instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 on hv-cinder-85221 Sep 09 12:27:34.161368 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-d6f8dcca-6e13-4466-8efd-d3c6fa535de2 req-eeb66bea-e3ab-4fb2-a2ca-14f19202e279 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Sep 09 12:27:34.161968 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 533/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:34.515491 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:34.516154 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:34.522655 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.523183 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.523627 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:34.524341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.524801 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.525231 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:34.557645 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.558133 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.558573 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:34.559060 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lazy-loading 'fault' on Instance uuid c0107a0d-0ecf-4b6b-9227-65da9d39c264 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:27:34.599163 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:34.606721 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e72f56f-711f-4fc0-be66-9a12f0f0c404 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 200 len: 1230 microversion: 2.1 time: 0.095235 Sep 09 12:27:34.607321 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 555/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:34 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:35.631142 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:35.631877 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: c0107a0d-0ecf-4b6b-9227-65da9d39c264] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:35.638521 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:35.639043 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:35.639485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:35.640178 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:35.640635 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:35.641066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:35.654377 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] HTTP exception thrown: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Request method failure captured: Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 HTTP/1.1 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy-nfsefQFyIpYyV7TvZQfDQadwe1yDFqSs9sR-KF-_aOF52JgDhutu-vqr1bvGpt3qnVqUtnF1x8430jC-SrxWh9z_In21-mJSQCkxns_fcbvLfDhDR-1fAinhlFG1VjhaIIbfe67AUjq1rwSEU3Ldwmp_OPsuw83NXuLwIFVKpDhs Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:27:35.656415 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: e2391d64c9304317bfb53e79ee0ca764 Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. Sep 09 12:27:35.658236 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'c0107a0d-0ecf-4b6b-9227-65da9d39c264'} Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:27:35.659374 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. Sep 09 12:27:35.661238 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:35.662800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Returning 404 to user: Instance c0107a0d-0ecf-4b6b-9227-65da9d39c264 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:27:35.662800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d48814b5-f943-405f-b5bd-a889a9e0a5c4 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264" status: 404 len: 111 microversion: 2.1 time: 0.030971 Sep 09 12:27:35.662800 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 534/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:35 2022] GET /compute/v2.1/servers/c0107a0d-0ecf-4b6b-9227-65da9d39c264 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:27:38.738526 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:38.739225 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:38.740624 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52fdd8f-1d71-4ae3-9548-a7ca99df88f9", "tag": "990bb37e-8d61-4f15-8bcf-815b5ac9368e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:38.745179 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:38.745933 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:38.746688 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:38.747657 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:38.748309 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:38.748547 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:38.751430 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:38.752148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:38.753190 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:38.766322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] Creating event network-changed:990bb37e-8d61-4f15-8bcf-815b5ac9368e for instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 on hv-cinder-85221 Sep 09 12:27:38.772197 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-58b4d833-344b-4892-a8d7-f696f88e3c2b req-3c6b96ba-26da-43a1-a805-83f4b4af78d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034912 Sep 09 12:27:38.772997 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 535/1090] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:27:38.782957 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:27:38.883259 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8af132c8-96ee-4373-9b1a-ff126ffb1393 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 204 len: 0 microversion: 2.1 time: 0.148854 Sep 09 12:27:38.884425 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 556/1091] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:27:38 2022] DELETE /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:27:38.894621 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:38.895989 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:38.906020 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:38.906794 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:38.907453 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:38.908172 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:38.908904 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:38.909556 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:39.070879 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:39.082862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-da605e18-aec7-4342-a8b6-8b7efab8cc0c tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1578 microversion: 2.1 time: 0.191550 Sep 09 12:27:39.082862 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 536/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:38 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:40.114087 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:40.114874 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:40.121262 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:40.121751 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:40.122194 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:40.122894 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:40.123377 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:40.123809 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:40.258729 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:40.266539 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f69e7764-e166-4aba-a6aa-cab8a03c27fc tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1578 microversion: 2.1 time: 0.156850 Sep 09 12:27:40.267140 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 557/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:40 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:40.791983 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52fdd8f-1d71-4ae3-9548-a7ca99df88f9", "name": "network-vif-deleted", "tag": "990bb37e-8d61-4f15-8bcf-815b5ac9368e"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:40.803133 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:40.803718 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:40.804266 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:40.817158 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] Creating event network-vif-deleted:990bb37e-8d61-4f15-8bcf-815b5ac9368e for instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 on hv-cinder-85221 Sep 09 12:27:40.822169 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-dcd45674-407d-44ab-af30-5f06c4e2857a req-3330fa2b-b76a-4ab7-84fd-a4f3f93da41d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035731 Sep 09 12:27:40.822764 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 537/1094] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:41.289533 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:41.290139 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:41.296629 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:41.297103 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:41.297542 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:41.299100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:41.299635 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:41.300078 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:41.342055 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:41.342778 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:41.343571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:41.344326 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lazy-loading 'fault' on Instance uuid a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:27:41.385826 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2391d64c9304317bfb53e79ee0ca764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c41d17597b4d3a8ffafa3d5bb87916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:41.394498 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d0b10555-2eb5-4ca5-a4d3-e64bae7a9b86 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 200 len: 1231 microversion: 2.1 time: 0.108765 Sep 09 12:27:41.395100 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 558/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:41 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:42.418821 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:42.419485 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: a52fdd8f-1d71-4ae3-9548-a7ca99df88f9] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:42.426218 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.426723 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.427182 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.427893 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.428343 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.428762 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.442066 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] HTTP exception thrown: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Request method failure captured: Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 HTTP/1.1 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy-nfsefQFyIpYyV7TvZQfDQadwe1yDFqSs9sR-KF-_aOF52JgDhutu-vqr1bvGpt3qnVqUtnF1x8430jC-SrxWh9z_In21-mJSQCkxns_fcbvLfDhDR-1fAinhlFG1VjhaIIbfe67AUjq1rwSEU3Ldwmp_OPsuw83NXuLwIFVKpDhs Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:27:42.443686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: e2391d64c9304317bfb53e79ee0ca764 Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. Sep 09 12:27:42.445379 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': 'a52fdd8f-1d71-4ae3-9548-a7ca99df88f9'} Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:27:42.446585 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. Sep 09 12:27:42.448220 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.449738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Returning 404 to user: Instance a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:27:42.449738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d0e028f-c7b7-4827-8b8c-494bd2c09870 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9" status: 404 len: 111 microversion: 2.1 time: 0.030539 Sep 09 12:27:42.449738 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 538/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:42 2022] GET /compute/v2.1/servers/a52fdd8f-1d71-4ae3-9548-a7ca99df88f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:27:42.896468 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:42.896965 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:42.903432 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.903913 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.904341 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.905021 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.906763 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.907228 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.921624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] HTTP exception thrown: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Request method failure captured: Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 HTTP/1.1 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Connection: close Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Host: 10.222.0.49 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjGy-nfsefQFyIpYyV7TvZQfDQadwe1yDFqSs9sR-KF-_aOF52JgDhutu-vqr1bvGpt3qnVqUtnF1x8430jC-SrxWh9z_In21-mJSQCkxns_fcbvLfDhDR-1fAinhlFG1VjhaIIbfe67AUjq1rwSEU3Ldwmp_OPsuw83NXuLwIFVKpDhs Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Role: member,reader Sep 09 12:27:42.923556 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Roles: member,reader Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Id: e2391d64c9304317bfb53e79ee0ca764 Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: method: > Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: exception: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.925272 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: action_args: {'id': '8f09e41f-24fb-4542-8243-81c8206f2198'} Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:27:42.926258 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.927624 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.929536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Returning 404 to user: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:27:42.929536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1f35d5c2-a457-42a5-a454-b76e45420355 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 404 len: 111 microversion: 2.1 time: 0.032285 Sep 09 12:27:42.929536 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 559/1097] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Sep 9 12:27:42 2022] DELETE /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:27:42.933981 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:42.934596 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] [instance: 8f09e41f-24fb-4542-8243-81c8206f2198] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:42.940657 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.941138 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.941569 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.942251 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Acquiring lock "25a97952-6949-40d3-b857-a309e55901ef" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:42.942702 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:42.943148 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Lock "25a97952-6949-40d3-b857-a309e55901ef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:42.956322 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] HTTP exception thrown: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Request method failure captured: Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 HTTP/1.1 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Connection: close Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Host: 10.222.0.49 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjGy-nfsefQFyIpYyV7TvZQfDQadwe1yDFqSs9sR-KF-_aOF52JgDhutu-vqr1bvGpt3qnVqUtnF1x8430jC-SrxWh9z_In21-mJSQCkxns_fcbvLfDhDR-1fAinhlFG1VjhaIIbfe67AUjq1rwSEU3Ldwmp_OPsuw83NXuLwIFVKpDhs Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 09 12:27:42.957815 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9c41d17597b4d3a8ffafa3d5bb87916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c9c41d17597b4d3a8ffafa3d5bb87916 Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-874492032 Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Id: e2391d64c9304317bfb53e79ee0ca764 Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-874492032-project Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: method: > Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: exception: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.959655 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: action_args: {'id': '8f09e41f-24fb-4542-8243-81c8206f2198'} Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:27:42.960686 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. Sep 09 12:27:42.962252 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 09 12:27:42.963960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Returning 404 to user: Instance 8f09e41f-24fb-4542-8243-81c8206f2198 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:27:42.963960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-82547f62-cbf9-4b57-bd5f-d9167b516297 tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198" status: 404 len: 111 microversion: 2.1 time: 0.029313 Sep 09 12:27:42.963960 dv-cinder-852211-12-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 539/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:42 2022] GET /compute/v2.1/servers/8f09e41f-24fb-4542-8243-81c8206f2198 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:27:44.497287 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-870e12f3-4b9b-4f4b-897c-4caaa990858f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] Calling method '.version_select at 0x7f6bd0b24a60>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:44.522571 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-870e12f3-4b9b-4f4b-897c-4caaa990858f tempest-TestVolumeBootPattern-874492032 tempest-TestVolumeBootPattern-874492032-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1082182416" status: 202 len: 0 microversion: 2.1 time: 0.029034 Sep 09 12:27:44.526415 dv-cinder-852211-12-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 560/1099] 10.222.0.49 () {58 vars in 1263 bytes} [Fri Sep 9 12:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1082182416 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)